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PREFACE 


For  the  eleventh  year,  the  Research  and  Theory  Division  of  the  Association 
for  Educational  Communications  and  Technology  (AECT)  is  publishing  these 
Proceedings.  Papers  published  in  this  volume  were  presented  at  the  national  AECT 
Convention  in  Dallas,  Texas.  A  limited  quantity  of  this  volume  were  printed  and 
sold.  It  is  also  available  on  microfiche  through  the  Educational  Resources 
Information  Clearinghouse  (ERIC)  system. 

REFEREEING  PROCESS:  All  research  papers  selected  for  presentation  at  the 
AECT  Convention  and  included  in  this  Proceedings  were  subjected  to  a  rigorous 
blind  reviewing  process.  Proposals  were  submitted  to  either  David  Jonassen  of  the 
University  of  Colorado  at  Denver  or  Dr.  Dean  Christensen  of  the  Control  Data 
Corporation  in  Minneapolis,  Minnesota  who  coordinated  the  review  process.  All 
references  to  author  were  removed  from  proposals  before  they  were  submitted  to 
referees  for  review.  Approximately  fifty  percent  of  the  manuscripts  submitted  for 
consideration  were  selected  for  presentation  at  the  Convention  and  for  Publication 
in  these  Proceedings.  The  papers  contained  in  this  document  represent  some  of  the 
most  current  thinking  in  educational  communications  and  technology. 

This  volume  contains  two  indexes  covering  this  volume.  The  first  is  an 
author  index;  the  second  is  a  descriptor  index.  The  two  indexes  will  be  updatea  in 
future  editions  of  this  Proceedings.  The  index  for  volumes  1-6  (1979-84)  are 
included  in  the  1986  Proceedings,  and  the  index  for  volumes  7-10  is  in  the  1988 
Proceedings. 
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INTRODUCTION 


Computer  use  in  our  society  is  growing  at  an  extremely  rapid  pace  mxy 
aspects  of  our  daily  lives  such  as  shopping,  banking  and  workplace  activities 
have  changed  dramatically  because  of  the  effects  of  computers.  The  U.S. 
Department  of  Labor  estimates  that  50-75%  of  jobs  will  invo  ve  computers  in 
some  way  by  the  time  today's  high  school  students  enter  the  job  market  (Sanders, 
1984).  In  this  decade  and  inaeasingly  in  decades  to  come,  computer  related  fields 
will  be  offering  many  of  our  society's  best  professional  employment 
opportunities  (Sanders,  1984).  During  the  last  five  years,  educators  throughout 
the  United  States  have  recognized  this  trend  and  have  responded  by  increasing 
the  incorporation  of  computer  study  in  schools. 

As  computers  become  increasingly  accepted  in  schools,  many  people  are 
concerned  that  gender  equity  is  being  ignored.  According  to  Anderson  et  al.(1984) 
and  Lockheed  et  al.(1984),  computer  learning  opportunities  are  less  common 
among  females.  This  problem  seems  to  stem  from  the  already  well-defined 
pattern  of  inequality,  which  exists  throughout  our  school  curricula  and  society  in 
geueral.  Indeed,  computer  study  may  be  exacerbating  this  situation  by  reinforcing 
existing  gender  inequities  rather  than  encouraging  educational  equity  (Schubert, 
1986). 

This  problem  of  inequity  in  computer  studies  (i.e.  unequal  access  to 
computer  resources  by  females)  has  several  serious  implications  for  the  future. 
Anderson  et  al.  (1984)  write: 

Educational  computer  inequity  threatens  to  separate 
groups  and  communities  by  giving  some  people  more 
effective  tools  for  living  in  the  age  of  computer 
information  systems  (p.lO). 
Sanders  (1984)  supports  this  view  by  arguing  that  gender  related  differences 
among  students  today  in  computer  education  are  likely  to  result  in  occupational 
and  economic  sex  discrepancy  in  the  future. 

In  many  elementary  and  middle  schools,  students'  participation  in  computer 
classes  is  compulsory,  and  thus,  every  student  in  those  schools  should  have 
equal  opportunities  to  learn  about  computers.  However,  a  number  of  recent 
studies  have  indicated  that  most  of  the  students  working  with  computers  at  the 
high  school  level  are  male,  and  as  age  increases,  female  enrollment  in  computer 
classes  decreases.  For  instance,  in  a  study  of  Princeton  High  School  students,  it 
was  found  that  60%  of  male  students,  and  only  8%  of  female  students  used 
school  computers  voluntarily  before,  during,  and/or  after  classes  (Sanders,  1984). 
Also,  in  a  study  of  freshman  students  from  an  introductory  psychology  class  at  a 
midwestern  state  university,  Dambrot  et  al.  (1985)  found  that  female  students 
showed  more  negative  attitudes  toward  computers  and  scored  lower  in 
computer  aptitude  tests  than  male  students.  Furthermore,  McCain(1983)  found 
that  female  students  show  a  tendency  to  take  general  introductory  computer 
courses  rather  than  more  advanced  courses. 
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Other  studies  have  found  sex  not  to  be  significantly  related  to  students' 
computing  abilities  and  their  attitudes  toward  computers.  For  example,  Loyd  and 
Gressard  (1984)  surveyed  354  high  school  and  college  students  concerning  their 
attitudes  toward  computers.  They  found  no  evidence  to  indicate  any  difference 
between  males  and  females  in  terms  of  computer  anxiety,  computer  confidence, 
and  computer  liking.  Further,  Mar.dinach  and  Fisher  (1985)  found  that  females 
and  maleb  performed  similarly  once  they  enrolled  in  computer  programming 
courses. 

The  results  are  inconclusive  concerning  gender  equity  in  computer  classes  in 
high  schools.  Some  school  districts  may  differ  from  others  in  regard  to  this 
problem.  The  ratio  of  males  in  computer  classes  may  differ  according  to  the  level 
of  the  class.  Finally,  where  gender  related  differences  in  high  school  courses  can 
be  foimd,  the  factors  which  contribute  to  the  problem  are  yet  fully  understood. 

Educators  need  to  realize  serious  impacts  of  gender  inequity  on  students* 
future  and  try  to  achieve  gender  equity  in  computer  education.  Thus,  the  first 
step  in  this  process  is  to  identify  possible  factors  influencing  the  differences.  As 
Schubert  (1986)  contends,  gender  related  differences  in  computer  education  are 
influenced  more  by  external  factors  than  by  internal  ones,  and  hindrances  to 
equitable  encouragement  of  female  and  male  students*  computer  learning  are 
due  to  various  sources.  It  is  possible  that  in  some  cases,  gender  related  differences 
may  be  influenced  by  social  expectations,  familial  influences,  peer  pressure, 
career  plans,  and  school  policies  which  assign  differential  attitudes  towards 
computer  study  to  male  and  female  high  school  students. 


PURPOSE 


The  purpose  of  the  present  studies  was  to  investigate  the  existence  of  gender 
related  differences  in  high  school  elective  computer  courses  in  a  mid  western 
urban  area  and  factors  affecting  the  differences.  A 1987  study  and  a  1988  follow-up 
study  have  been  conducted  to  the  students  enrolled  in  high  schools  in  the 
Madison  Metropolitan  School  District  in  the  state  of  Wisconsin.  The  first  study 
focused  on  three  key  areas  of  concern.  First,  it  examined  to  what  extent  if  any, 
there  existed  gender  related  differences  in  actual  enrollment  figures.  Second,  it 
also  seeks  to  determine  whether  gender  related  differences  were  in  any  way 
related  to  computer  course  levels.  Third,  it  explored  possible  factors  influencing 
the  differences.  Previous  research  indicates  that  there  may  exist  a  relationship 
between  students*  attitudes  toward  computers  and  their  participation  in 
computer  classes.  Further,  these  attitudes  may  be  related  to  other  factors  such  as 
role  models  and  future  career  plans.  The  study  intended  to  identify  high  school 
students*  attitude  toward  computers  and  to  determine  whether  they  differ  in 
relation  to  student  gender,  computer  course  level,  role  models,  experience  with 
computers,  and  students*  future  plans  concerning  computer  careers. 

A  study  follow-up  conducted  to  extend  the  findings  of  the  first  study.  In  the 
second  study,  the  students  who  were  not  enrolled  in  elective  computer  courses 
as  well  as  those  who  were  enrolled  in  the  courses  were  surveyed.  The  purpose  of 
the  study  was  to  examine  differences  between  students  who  have  taken  at  least 
one  elective  computer  course  and  those  who  have  not  taken  any  in  relation  to 
their  gender,  attitude  toward  computers,  experience  with  computers,  plans  for 
taking  more  high  school  computer  classes,  future  plans  concerning  computer 
careers,  and  role  models.  In  addition,  the  researchers  explored  how  students  who 
have  taken  at  least  one  elective  computer  course  felt  about  the  overall  course, 
and  peers  and  teachers  in  the  course.  ^  ^ 
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STUDY  1 


Objectives 

The  following  research  questions  were  examined: 

1)  Is  there  a  gender  related  difference  in  enrollment  in  computer  courses? 

2)  Does  the  difference  in  enrolhnent  change  as  the  level  of  computer  class 
increases? 

3)  Do  gender  a;ad  course  level  related  differences  exist  among  students 
enrolled  in  computer  classes  in  terms  of  the  following  criteria: 

general  attitudes  toward  computers 
confidence  with  computers 
perceived  usefulness  of  computers 
gender  related  bias  toward  computer  use 
plans  for  further  computer  study  or  professional  work 
role  models 

experience  with  computers 
Method 

A  survey  was  administered  to  the  total  population  of  students  enrolled  in 
high  school  elective  compute*-  courses  in  the  Madison  Metropolitan  School 
District  during  the  fall  of  1987,  There  were  a  total  number  of  166  respondents,  104 
of  which  were  male  and  62  of  which  were  females.  Data  were  also  collected  from 
four  high  schools  in  the  district  concerning  male  and  female  enrollment 
numbers  for  all  beginning  and  intermediate  computer  classes. 

A  survey  was  developed  which  addressed  attitudes  towards  computer  use. 
The  first  part  of  the  survey  was  adapted  from  a  computer  attitude  scale  used  in  a 
published  study  (Swadener  and  Hannafin,  1987).  It  consisted  of  seventeen 
questions  utilizing  a  five  item  Likert  scale  ranging  from  strongly  disagree  to 
strongly  agree  and  posed  questions  concerning  general  attitudes  toward 
computers,  self  confidence,  computer  utility,  and  sex  bias. 

The  second  part  of  the  survey  consisted  of  questions  relating  to  male  and 
female  role  models  who  use  computers,  total  time  spent  with  computers,  and 
plans  for  future  computer  study  and  professional  work. 

The  data  on  enrollment  figures  werf>  analyzed  using  the  Chi-square  test  of 
population  to  determine  any  differences  between  males  and  females  and 
introductory  and  intermediate  level  courses. 

The  data  concerning  the  other  variables  addressed  by  the  survey  were 
analyzed  according  to  gender  and  course  level  differences  by  comparing  their 
means  and  performing  an  analysis  of  variance  (one  way  /  MOV  A). 
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Results 


The  differences  between  males  and  females  in  beginning  and  intermediate 
dass  were  most  apparent  in  the  role  models  available  to  the  students,  sex  bias 
and  their  view  of  gender  differences.  The  general  attitude  of  the  students, 
perceived  usefuhiess  and  self  confidence  in  use  of  computers  did  not  produce 
significant  differences.  The  charts  and  graphs  illustrating  the  differences  that 
were  found  are  presented  in  the  appendix  1. 

The  difference  in  the  numbers  of  computer  students  is  illustrated  by  chart  1. 
The  number  of  females  is  less  for  beginning  computer  courses  with  the  largest 
difference  appearing  in  the  intermediate  courses.  Anecdotal  information  from 
computer  teachers  indicates  that  these  differences  are  historical  and  that  the 
number  of  beginning  dass  females  is  usually  lower. 

The  role  model  data  presented  (charts  2-5)  show  that  female  students  in 
computer  classes  tend  to  have  a  larger  number  of  role  models  than  the  males  in 
these  dasses.  This  apparent  difference  is  larger  for  females  with  female  role 
models  than  females  with  male  role  modds. 

The  attitudes  of  computer  students  about  males  and  females  in  relation  to 
computers  is  given  in  sex  bias  and  perceived  differences  charts  5  and  6.  The 
stereotypical  sex  bias  of  males  and  computers  is  higher  for  males  than  for  females 
with  a  slight  increase  from  first  to  second  courses.  The  perception  of  computers 
as  a  male  domain  is  high  for  beginning  females  and  nonexistent  for  intermediate 
females  while  the  same  perception  increased  for  males  (some  student  wrote  the 
the  low  partidpation  of  females  in  intermediate  courses  is  proof  of  a  difference). 


Discussion 

Some  of  the  more  popular  beliefe  about  differences  between  males  and 
females  seem  not  to  be  present  in  this  study.  The  attitudes  of  females  appear  to  be 
jiist  as  positive  toward  computers  as  that  of  the  males  in  the  study.  The 
difference  in  the  sex  bias  and  perceived  differences  between  male  and  female 
abilities  appear  to  be  related  to  a  readUy  observable  drop  in  female  enrollment  in 
intermediate  computer  science  dasses.  The  striking  difference  in  the  total 
number  of  role  models  and  female  role  models  for  female  students  in 
intermediate  computer  sdence  courses  could  have  the  greatest  practical 
significance.  Tne  positive  encouragement  of  parents  and  friends  may  make  the 
difference  between  contribution  in  computer  study  for  females. 


Further  Study 

The  differences  between  females  in  computer  classes  and  those  not  taking 
computer  classes  would  be  an  avenue  of  pursuit.  The  factors  that  contribute  to 
low  enrollment  of  females  in  computer  science  may  be  evident  in  students  that 
do  not  take  such  courses.  There  may  also  some  differences  between  females 
enrolled  in  computer  sdence  courses  and  business  education  computer  courses. 
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STUDY  2 


Objectives 

The  research  questions  that  guided  this  follow-up  study  were: 

1)  Do  gender  related  differences  exist  between  students  who  have  taken  at 
least  one  elective  computer  course  and  those  who  have  not  taken  any 
computer  course  in  terms  of  the  following  criteria: 

general  attitudes  toward  computers 

confidence  with  computers 

perceived  usefulness  of  computers 

gender  related  bias  toward  computer  use 

plans  for  further  computer  study  or  professional  work 

role  models 

experience  with  computers 

2)  Do  gender  related  differences  exist  among  the  students  who  have  taken 
at  least  one  elective  computer  course  in  terms  of  the  following  criteria: 

feeling  toward  the  course 
interaction  with  peers  in  the  course 
interaction  with  teachers  in  the  course 


Method 

This  study  was  conducted  in  the  fall  of  1988.  Scudents  who  were  not  enrolled 
in  computer  courses  as  well  as  the  students  enrolled  in  computer  courses  were 
surveyed.  There  were  a  total  number  of  328  respondents,  195  of  which  were  male 
and  133  of  which  were  females.  Data  were  collected  from  th'^  three  high  schools 
in  the  Madison  Metropolitan  School  District.  All  the  students  enrolled  in 
computer  courses  in  the  three  schools  were  surveyed.  Non-computer  science 
student  results  were  obtained  by  randomly  selecting  homerooms  and  having 
students  in  the  selected  homerooms  answer  the  survey.  Those  who  were 
enrolled  both  in  computer  courses  and  in  the  selected  homerooms  did  not 
complete  the  survey  a  second  time. 

The  survey  developed  for  the  first  study  was  added  to  and  modified  for  the 
second  study  (appendix  4).  In  part  two  of  the  original  survey,  the  following 
questions  were  added:  whether  students  have  taken  any  high  school  elective 
computer  courses  or  not;  how  many  elective  computer  courses  they  have  taken 
in  high  schools;  if  they  have  taken  any,  how  they  felt  about  the  overall  course, 
and  peers  and  teachers  in  the  course;  and  whether  th*ey  plan  to  take  a  computer 
course  later  in  high  schools.  A  role  model  check  list  matrix  was  developed  to 
replace  open-ended  questions  concerning  use  of  computers  by  acquaintances  in 
the  workplace,  home  and  school.  Space  was  provided  for  comments  about 
gender  related  attitudes,  computer  learning  and  the  importance  about  computers 
on  the  page  three  as  well  as  for  additional  overall  comments  on  the  page  four. 

The  data  concerning  students*  future  plans  and  attitudes  were  analyzed 
using  the  Mann-Whitney  U  test  to  detem^  any  difference  between  the 
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students  who  have  taken  at  least  one  elective  high  school  computer  course  and 
those  who  have  not  taken  any  elective  computer  course  in  high  school.  The 
same  test  was  also  used  to  determine  any  difference  between  the  students  who 
intend  to  take  a  computer  course  in  high  school  and  those  who  do  not  intend  to 
take  it  in  relation  to  their  future  plans,  attitudes  and  (if  they  have  taken  any 
computer  course)  their  overall  feeling  toward  the  course  and  interaction  with 
peers  and  teachers  in  the  course. 

The  data  on  total  time  spent  with  computers  and  role  models  were  analyzed 
by  performing  the  T-test  to  explore  any  existence  of  difference  between  the 
students  who  have  taken  any  elective  computer  course  and  those  who  have  not, 
and  between  those  who  intend  to  take  a  computer  course  in  high  school  and 
those  who  do  not  intend  to  take  a  course. 

Further,  in  order  to  establish  the  strength  of  the  relationships,  Pearson  R 
Correlation  was  calculated  for  interval  data  and  the  Spearman  R  correlation  for 
Likert  scale  data.  All  the  statistical  analyses  were  conducted  for  males  and 
females  separately. 


Results 

Differences  between  the  students  who  have  taken  a  computer  course  (tables  3 
&  5)  and  those  who  have  not  and  between  those  who  intend  to  take  a  high 
school  computer  course  and  those  who  do  not  were  significant  for  both  males 
and  females  (appendix  2  contains  tables  1-8).  Plans  for  taking  a  computer  course 
after  high  school,  plans  for  having  a  computer  related  job,  perceived  usefuh\ess 
of  computers,  general  attitudes  toward  computers  and  confidence  with 
computers  were  all  more  positive  for  computer  course  students  and  those  who 
intend  to  take  a  computer  course.  For  students'  gender  related  bias  toward 
computer  use,  differences  were  apparent  only  for  males.  Significant  differences 
were  found  for  both  females  and  males  who  intend  to  take  a  computer  course 
and  plan  to  major  in  computer  science  in  college.  No  difference  was  found  for 
those  who  have  and  have  not  taken  computer  courees. 

Students  who  have  taken  a  high  school  computer  course  (table  7)  were  asked 
to  describe  their  overall  feeling  toward  the  course,  the  difference  between  those 
who  intend  to  take  a  computer  course  in  high  school  and  those  who  do  not  was 
significant  only  for  females.  Students'  overall  feeling  toward  interaction  with 
peers  and  teachers  showed  no  significant  difference. 

The  correlation  data  with  regard  to  plans  for  computer  work  after  high 
school  (table  4)  show  slight  to  moderate  relationships  with  computer  course 
participation  and  the  desire  to  take  a  computer  course.  These  correlations, 
however,  show  littie  difference  between  males  and  females.  It  can  be  noted  that 
the  only  comparisons  that  were  not  slightiy  correlated  were  for  both  males  and 
females  who  have  taken  a  computer  course. 

The  attitudes  of  respondents  (table  6)  show  mostly  moderate  correlations  in 
relation  to  course  participation  and  expressed  intent  for  a  computer  course. 
There  is  littie  difference  in  correlations  for  males  and  females  on  any  of  Uiese 
scales.  The  negative  values  for  Uie  sex  bias  scale  is  the  result  of  inversion  of  this 
scale  (less  bias  is  a  lower  value  on  the  scale). 

For  students  who  have  taken  computer  class,  the  correlation  between 
expressed  interest  in  another  course  (table  7)  and  whether  they  liked  the 
current/past  computer  course  was  moderate.  The  correlation  for  males  and 
females  was  similar.  All  other  cells  show  slight  or  no  correlation. 
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The  hours  of  use  for  male  and  female  computer  students  (table  8)  was 
substantially  different  than  for  those  who  have  not  taken  a  computer  course. 
The  correlation  value  for  these  factors  was  moderate.  The  difference  between 
intent  to  take  a  course  in  relation  to  hours  of  computer  use  was  only  significant 
for  males.  The  correlation  for  both  males  and  female  was  slight. 

Role  models  for  students  both  intending  to  take  a  computer  course  (tables  1 
&  2)  and  actual  participants  showed  significant  differences  with  respect  mostly  to 
male  role  models.  These  differences  were  also  more  prevalent  in  the  home  and 
school  than  in  the  workplace.  The  number  of  school  friends  who  use  computers 
were  significant  different  for  males  and  females  who  have  taken  a  computer 
course.  Females  who  intend  to  take  a  computer  course  knew  a  significantly 
larger  number  of  computer  using  friends  than  those  who  did  not  intend  to  take  a 
computer  course.  The  males  in  this  category  do  not  show  any  significant 
difference. 

Students*  anecdotal  answers  to  open-ended  questions  are  given  in  appendix 
3.  These  responses  are  included  to  give  the  reader  a  better  feel  for  the  way  in 
which  students  view  their  current  or  potential  participation  in  computer 
courses.  For  the  most  part  they  seem  illustrative  of  the  significant  findings  in 
this  study  and  do  not  hold  any  surprises. 


Discussion 

The  overall  pattern  of  computer  course  participation  and  intent  to  participate 
holds  few  surprises.  The  difference  in  attitudes,  interest  and  participation  in 
computer  use  seems  to  be  fairly  consistent  and  predictable  for  both  males  and 
females.  Only  in  a  few  instances  do  males  and  females  differ  on  some  points. 
This  is  perhaps  an  important  consideration  because  of  the  generally  accepted  but 
not  supported  claim  that  some  make  about  differences  between  males  and 
females. 

Students  who  perceive  computers  in  a  positive  way  are  more  likely  to  also  be 
interested  in  taking  a(another)  computer  course.  Students  that  perceive 
computers  to  be  useful  are  more  likely  to  have  been  enrolled  in  a  computer 
course.  The  general  attitude  toward  computers  is  also  more  positive  for 
computer  students.  Self  confidence  is  higher  for  computer  students  as  well.  This 
is  supported  in  the  significant  difference  in  self  confidence,  perceived  usefulness 
of  computers  and  general  attitude  scales.  The  only  difference  between  males  and 
females  in  attitudes  surfaced  in  the  area  of  sex  bias.  Males  who  have  participated 
in  a  computer  class  are  significantly  less  biased  than  those  who  have  not 
participated.  Females  on  the  other  hand  do  not  appear  to  differ  greatly  in  sex  bias 
regardless  of  course  participation.  The  lower  sex  bias  of  males  who  have  taken  a 
computer  course  is  still  not  as  low  as  females  who  either  have  or  have  not  taken 
a  course. 

The  number  of  role  models  for  males  and  females,  for  the  most  part,  is 
similar  for  both  genders  with  a  couple  of  notable  exceptions.  The  data  for  work 
role  models  shows  little  relationship  to  participation  in  computer  courses  or  the 
intent  to  participate.  This  seems  to  indicate  the  work  place  is  not  particularly 
important  in  making  course  related  decisions.  The  presence  of  friends  who  are 
computer  users  at  home  appears  to  have  a  differential  effect  on  males.  Those 
with  male  friends  who  use  computers  at  home  are  more  likely  to  be  computer 
course  participants  and  be  interested  in  taking  a  course.  A  comparable 
relationship  does  not  exist  for  females.  There  is  a  male  teacher  relationship  to 
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participation  hut  this  may  be  explained  by  ti\e  high  number  of  male  teachers  in 
computer  courses.  The  most  consistent  finding  is  the  relationship  between 
computer  using  friends  at  school  and  participation.  Females  show  a  strong 
relations  between  intent  to  take  a  course  and  computer  using  friends  at  school. 
This  is  not  true  for  males. 

Students  who  have  or  are  taking  computer  classes  when  reporting  their  peer 
and  teacher  interactions  do  not  indicate  any  relation  to  future  course 
participation.  This  may  indicate  that  other  factors  are  greater  determinants  in 
their  decision  than  the  apparent  helpfulness  of  others  in  class.  Their  general  like 
or  dislike  of  the  computer  class  was  related  to  this  decision.  Possible  reasons  for 
's  feeling  were  not  included  in  this  survey. 


Further  Study 

The  differences  and  similarities  between  males  and  females  discovered  in 
this  study  do  not  solve  the  question  of  unequal  participation  in  computer  science 
classes  by  males  and  females.  It  appears  that  friends  in  school  are  a  greater 
influence  for  females  than  males  in  making  computer  related  decisions  but  with 
low  initial  female  participation  in  computer  class  this  trend  may  be  slow  to  turn 
around.  A  more  detailed  examination  of  role  models  with  more  sensitive 
instruments  would  be  in  order.  Personal  interviews  with  high  school  students 
may  also  shed  more  light  on  the  reasons  for  this  differential  participation. 
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Chart  1 


Computer  Science  Classes 
Proportion  of  Females 


50.5% 


Foil  Semester  1987  Enrollment 

The  percent  prcpcrticns  given 
are  for  all  computer  science 
classes  conducted  in  Ihe  Fall 
semester  of  1987  for  four  Madison 
Metropolitan  School  District  High 
Schools.  The  'All  Other*  category 
represents  the  proportion  of 
females  that  are  not  emrolled 
in  computer  science  courses. 
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Chart  2 


All  Role  Models  Combined 


Female 


0        1        2        3       4        5       6  7 
Avtragt 


The  average  number  of  role  models  g^/en  for  home,  work  and  school 
regardless  of  role  model  gender.  The  averages  of  role  models  are  given  by 


level  of  class  and  gender. 

Group  N  Mean  SD 

Beginning  Male  68  3.96  1.92 

Beginning  Female  57  4.84  2.40 

Intermediate  Male  36  4.25  1.57 

Intermediate  Female  5  6.40  2.30 
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Chart  3 


Male  Role  Models 


0.0  0.5  1.0  1.5  2.0 

Avaraga 


The  average  number  of  role  models  who  are  males  for  home,  work  and 
school.  The  averages  of  role  models  are  given  by  level  of  class  and  gender. 


Group 

N 

Mean 

SD 

Beginning  Male 

68 

1.06 

1.02 

Beginning  Female 

57 

1.12 

1.18 

Intermediate  Male 

36 

1.17 

.97 

Intermediate  Female 

5 

2.00 

1.00 

♦ 
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Chart  4 


Female  Role  Models 


Intermediate  Female 


Intarmediatt  Male 


Beginning  Female 


The  average  number  of  role  models  who  are  females  for  home,  work  and 
schoni.  The  averages  of  role  models  are  given  by  level  of  class  and  gender. 


Group 

Beginning  Male 
Beginning  Female 


Intermediate  Male 


Intpi-mediate  Female 


N 
68 
57 
36 

5 


Mean 

.72 
.98 
.78 
1.60 


SD 

.75 
1.09 

.72 
1.14 
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Chart  5 

Sex  Bias 


Intermediate  Male 


0  12  3  4 

Average 


The  average  total  response  to  three  questions  on  the  ability  of  males  and 
females  to  do  equally  well  in  working  with  computers.  The  averages  of 
^ex  bias  are  given  by  level  of  class  and  gender. 


Group 

N 

Mean 

SD 

Beginning  Male 

68 

2.44 

2.50 

Beginning  Female 

57 

1.05 

1.85 

Intermediate  Male 

36 

3.67 

2.35 

Intermediate  Female 

5 

1.40 

2.07 
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Chart  6 

Perceived  Difference 


Intermediate  Female 


Intermediate  Male 


Beginning  Female 


Beginning  Male 


0.0 


0.1 


0.2 
Average 


0.3 


0.4 


The  average  of  the  perception  that  there  is  no  difference  between  nnales 
and  females  in  computer  use.  A  score  of  0  indicates  that  there  is  no 
difference  and  a  1  indicates  that  there  is  a  differ^oce.  The  averages  of 
perceived  differences  are  given  by  level  of  class  and  gender. 


Group  N  Mean  SD 

Beginning  Male  52  .08  .27 

Beginning  Female  52  .06  .24 

Intermediate  Male  28  .32  .48 

Intermediate  Femr'e  3  .00  .00 
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Table  1 
Role  Models 

T-test  for  the  comparison  of  the  number  of  role  models  between  students  who  have 
taken  a  computer  course  with  those  who  have  not  and  between  those  who  intend  to 
take  a(another)  computer  course  and  those  who  do  not  intend  to  take  a  computer  course 
in  high  school. 

Taken  Intended 


Male 

iviaic 

WPM 

.4188 

.170U 

WPF 

.2868 

.9270 

6(^ft7 

WB 

.0205 

107^ 

.  1 7/  J 

na 

WS 

.8898 

.4983 

na 

.3608 

WFrM 

.1703 

.6309 

.6761 

2314 

WFrF 

.7807 

.6821 

.8980 

.9378 

HPM 

.0344 

2139 

.4578 

5028 

HPF 

X  XX  X 

AIDS 

,ZooZ 

.6221 

.8632 

xlO 

.3610 

3538 

.1967 

.0801 

HS 

.3315 

.6319 

na 

.8524 

HFrM 

.0052 

.6352 

.0942 

.3738 

HFrF 

.3177 

.9025 

.6509 

.1303 

ScTM 

.0000 

.0005 

5079 

.0231 

ScTF 

.0576 

.3805 

.6974 

.8634 

SccB 

.2965 

.3757 

.4721 

.0801 

ScS 

.0191 

.2359 

.1967 

•,  .9030 

ScFrM 

.0000 

.0776 

.2239 

.0696 

ScFrF 

.0000 

.0206 

5989 

.0048 

na:  SD  = 

0  for  one  variable 

W  -  work 

H  -  home 

Sc  -  school 

P  -  parent 

B  -  brother 

S  -  sister 

Fr  -  friend 

M  -  male 

F  -  female 

Note:  For  the  purpose  of  discussion,  results  that  have  values  less  than  p  =  .1000  is  considered  significant 
and  indicated  by  bold  type.  These  data  may  be  useful  for  determining  further  directions  for  investiga- 
tion. 


ERIC 


21 

32 


Table  2 
Role  Models 


Pearson  R  correlation  for  the  comparison  of  the  number  of  role  models  between  stu- 
dents who  have  taken  a  computer  course  with  those  who  have  not  and  between  those 
who  intend  to  take  a(another)  computer  course  and  those  who  do  not  intend  to  take  a 
computer  course  in  high  school. 

Taken  Intended 


Male 

Female 

Male 

WPM 

.0612 

.0485 

1081* 

WPF 

.0''88 

.0030 

0403 

WB 

.1669* 

.0387 

1083* 

WS 

.0073 

.0621 

.1733* 

-.0972 

WFrM 

.0987 

.0444 

.0361 

.1258* 

WFrF 

0191 

•  KJJO/ 

-.uuoz 

.UUii 

HPM 

.1510* 

.1113* 

-.0643 

.0717 

HPF 

.0253 

.0917 

-.0428 

.0146 

HB 

.0673 

.0838 

.1080* 

.1812* 

HS 

.0711 

.0440 

.1965* 

-.0! 

HFrM 

.2036* 

.0432 

.1391* 

.0957 

HFrF 

.0731 

.0063 

.0391 

1572* 

ScTM 

.4459** 

.3223** 

.0578 

.2346* 

ScTF 

.1360* 

.0793 

.0333 

.0147 

SccB 

.0764 

.0800 

-.0624 

.1811* 

ScS 

.1683* 

.1064* 

.1083* 

.0079 

ScFrM 

.4352** 

.1568* 

.1032* 

.1877* 

ScFrF 

.3664** 

.2038* 

.0455 

.2939" 

•  Slight 

**  Moderate 

***  Strong 

W 

-  work 

H  -  home 

Sc  -  school 

P- 

parent 

B  -  brother 

S  -  sister 

Fr 

-friend 

M  -  male 

F  -  female 

Note:  For  the  purpose  of  discussion,  results  that  have  values  between  .1000  and  3.000  are  considered 
slight,  between  3000  and  point  5000  are  considered  moderate  and  those  above  .5000  are  considered 
strong. 
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Table  3 
After  High  School  Plans 


Mann-Whitney  test  for  the  comparison  of  post  high  school  participation  in  computer  re- 
lated activities. 

Taken 

Male 

After  high  school  course  .0000 
Computer  science  major  .3618 
Computer  job  .0001 


Intended 

Female 

Male 

Female 

.0180 

.0545 

.0128 

.7432 

.0134 

.0730 

.0010 

.0001 

.0007 

Note:  For  the  purpose  of  discussion,  results  that  have  values  less  than  p  =  .1000  is  considered  significant 
and  indicated  by  bold  type. 


Table  4 
After  High  School  Plans 

Spearman  R  correlation  for  the  comparison  of  post  high  school  participation  in  comput- 
er related  activities. 

Taken  Intended 
Male  Female  Male  Female 

After  high  school  course  .2436*  .2406*  .2222*  .2950* 

Computer  science  major  .0742  .0342  .2336*  .1969* 

Computer  job  .3460**         .3302**  .4475**  .4304** 

♦  Slight 
**  Moderate 
**♦  Strong 


Note:  For  the  purpose  of  discussion,  results  that  have  values  between  .1000  and  3.000  are  considered 
slight,  between  3000  and  point  5000  are  considered  moderate  and  those  above  .5000  are  considered 
strong. 
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Table  5 
Attitudes 


Mann-Whitney  test  for  the  comparison  of  student  attitudes  in  relation  to  gender  bias, 
utility  of  computers,  general  attitude  toward  computers  and  self  confidence  in  the  use 
of  computers. 


Taken 

Intended 

Male 

Female 

Male 

Female 

Sex  bias 

.0635 

.2335 

.0445 

.6564 

Utility 

.0004 

.0001 

.0000 

.0001 

General  attitude 

.0000 

.0001 

.0004 

.0034 

Self  confidence 

.0000 

.0002 

.0000 

.0002 

Note:  For  the  purpose  of  discussion,  results  that  ha  2  values  less  than  p  =  .1000  is  considered  significant 
and  indicated  by  bold  type. 


Table  6 
Attitudes 

Spearman  R  correlation  for  the  relationship  of  student  attitude  to  gender  bias,  utility  of 
computers,  general  attitude  toward  computers  and  self  confidence  in  the  use  of  comput- 
ers. 


Taken 

Intended 

Male 

Female 

Male 

Female 

Sex  bias 

-.135r 

-.1160» 

-.1865» 

-.1198» 

UtiUty 

.177V 

.mi** 

.3601»» 

.3196»» 

General  attitude 

A\\7** 

.3565»» 

.5565*»» 

.5099*** 

Self  confidence 

.5664»»» 

.6766*** 

.4687»» 

.4447** 

♦  ^ligh^ 
•*  Moderate 
***  Strong 

Note:  For  the  purpose  of  discussion,  results  that  have  values  between  .1000  and  3.000  arc  considered 
slight,  between  3000  and  point  .5000  are  considered  moderate  and  those  above  5000  are  considered 
strong. 
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Table  7 
Attitudes 


Mann-Whitney  test  and  Speara\an  R  correlation  for  the  comparison  of  shxdent  attihides 
in  relation  to  how  they  liked  computer  class(esX  the  helpfulness  of  peers  and  availabili- 
ty of  teachers  for  assistance  between  those  shidents  who  have  indicated  they  would 
take  another  computer  class  and  those  who  would  not  take  another  computer  class. 


Mann-Whitney  Correlation 
Male  Female  Male  Female 

Liked  class  .1358  .0583  .3313**  .3407** 

Helpfulness  of  peers      .6182  .4946  .0900  .1366* 

Availability  of  teachers   .8451  .3878  .0517  .2485* 

»  Slight 
*•  Moderate 
***  Strong 

Note:  For  the  purpose  of  discussion,  results  that  have  values  less  than  p  =  .1000  is  considered  significant 
and  indicated  by  bold  type.  Correlation  results  that  have  values  between  .1000  and  3.000  are  considered 
shght,  between  3000  and  point  5000  are  considered  moderate  and  those  above  3000  are  considered 
strong. 


Table  8 
Hours  of  use 

T-tests  and  Pearson  R  correlation  for  tiie  comparison  of  hours  of  computer  use  in  rela- 
tion to  participation  in  computer  courses  and  intent  to  participate  in  a  computer  course. 

Taken  Intended 
Male  Female  Male  Female 

T-test  .0001  .0000  .0560  .2415 

Correlation  .3057**        .4581**  .1582*  .1229* 

*  Slight 
**  Moderate 
»»•  Strong 

Note:  For  the  purpose  of  discussion,  results  that  have  values  less  than  p  =  .1000  is  considered  significant 
and  indicated  by  bold  type.  Correlation  results  that  have  values  between  .1000  and  3.000  are  considertxl 
slight,  between  3000  and  point  5000  are  considered  moderate  and  those  above  .5000  are  considered 
strong. 
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APPENDIX  3 


1 :  female 

Why  haven't  you  taken  a  high  school  computer  course? 
"I  don't  understand  them  and  I  am  afraid  to  flunk.  Computers  are  for  smart 
people." 

Would  you  take  a  computer  course  in  high  school  if  possible? 
"Yes,  if  I  thought  the  teacher  could  teach  it  to  me." 

Make  any  additional  comments  concerning  computer  courses. 
"I'd  like  to  learn.  It  is  not  like  I  hate  them.  I  would  not  mind  sitting  behind  a 
computer  for  8  hours  a  day.  I  hope  I  will  understand  them  more  someday." 

2 :  female 

Why  haven't  you  taken  a  high  school  computer  course? 
"Because  I  don't  like  computers.  They  are  confusing  and  smarter  than  I  am, 
and  I  don't  understand  how  to  use  them." 

Give  your  thoughts  about:  some  people  think  that  it  is  difficult  to  learn  to 
use  computers. 

"Yes,  it  is.  The  computer  is  smarter  than  you  and  it  makes  you  feel  stupid 
when  you  did  not  do  something  right." 

3:  female 

Give  your  thought  about:  some  people  think  that  it  is  becoming  increasingly 
important  to  know  how  to  use  the  computer. 

"It  is  and  that  is  not  good  because  they  will  over  run  the  worid." 

4:  male 

Make  any  additional  comments  concerning  computer  courses. 
"Courses  should  be  less  lecture  and  more  hands  on  type  work.  Lectures  could 
be  given  in  the  lab  so  the  students  can  see  how  the  work  is  applied  first  hand." 

5 :  male 

Make  any  additional  comments  concerning  computer  courses. 
"I'd  take  some  more  classes  if  they  were  available." 

6 :  female 

Why  haven't  you  taken  a  high  school  computer  course? 

"Because  I  don't  have  a  computer  at  home.  I  don't  have  any  use  to  yet." 

7:  male 

Give  your  thought  about:  some  people  think  that  it  is  difficult  to  learn  to  use 
the  computer. 

"Yes,  it  is,  if  you  don't  have  a  good  teacher." 
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8:  female 

Make  any  additional  comments  concerning  computer  courses. 

'There  should  be  a  class  just  for  typing  like  on  an  every  other  day  basic  for 
only  like  a  half  hour  schedule.  Because  I  don't  want  a  computer  major,  I  want  to 
know  how  to  type." 

9:  female 

Why  haven't  you  taken  a  high  school  computer  course? 

"I  don't  like  working  with  computers  and  it  is  too  much  like  typing." 

Give  your  thought  about:  some  people  think  that  there  is  a  difference 
betwea\  males  and  females  in  how  they  feel  about  computers. 

'It  seems  like  guys  think  that  using  a  computer  is  uncool,  but  girls  are  a  little 
more  open-minded." 

10:  female 

Why  haven't  you  taken  a  high  «.>iiool  computer  course? 
"Because  there  are  other  important  classes  that  I  need  to  take." 

11:  female 

Give  your  thought  about:  some  people  think  that  it  is  becoming  increasingly 
important  to  know  how  to  use  the  computer. 

"For  people  who  are  not  willing  to  learn,  that  can  be  difficult.  Otherwise  it  is 
very  easy  to  learn." 
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Computer  Survey  Page  1 

Circle  the  letters  that  most  closely  match  how  you  feel  about  each  statement. 


SO  •  Strongly  Disagree   D  •  Disagree  NO  •  No  Opinion 

A-A{ 

jree  SA 

•  Strongiy  A{ 

1 

i  would  %R  to  own  my  own  computer. 

SD 

D 

NO 

A 

SA 

2 

Worl<'ng  with  a  computer  makes  me 
want  to  ieam. 

SD 

\J 

NO 

A 

SA 

3. 

i  ieai'n  a  lot  with  a  computer. 

D 

NO 

A 
r\ 

Being  able  to  work  with  a  computer 
is  important. 

SD 

D 

NO 

A 

SA 

5. 

1  like  to  use  a  comDuti^r 

Qn 

D 

NO 

A 
A 

O  A 

oA 

1  likG  usina  comDuteirs  in  school 

D 

NO 

A 
M 

QA 
oA 

7 

1  enjoy  making  a  computer 
do  what  1  want 

w  1  lul  1  well  It* 

SD 

D 

NO 

A 

SA 

o 

o. 

1  don't  like  working  on  a  computer. 

SD 

D 

NO 

A 
r\ 

QA 

Q 

ConriDutGrs  ars  a  tool  iust  like  a  hammer 
or  saw. 

D 

NO 

A 

OA 
oA 

10. 

Using  a  computer  is  a  waste  of  time. 

SD 

D 

NO 

A 

SA 

11. 

Using  computers  Is  more  for  boys 
than  for  girls. 

SD 

D 

NO 

A 

SA 

12. 

People  doni  need  computers. 

SD 

D 

NO 

A 

SA 

13. 

1  enjoy  using  the  computer. 

SD 

D 

NO 

A 

SA 

14. 

Computers  are  more  for  boys  than  girls. 

SD 

D 

NO 

A 

SA 

15. 

1  am  good  at  running  a  computer. 

SD 

D 

NO 

A 

SA 

16. 

Girls  do  just  as  well  as  boys  in 
computer  jobs. 

SD 

D 

NO 

A 

SA 

17. 

1  don1  work  well  with  computers. 

SD 

D 

NO 

A 

SA 
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Computer  Survey  Page  2 

Please  circle: 


Grade 

9  10 

11  12 

Age 

14  15 

16  17 

Sex 

Male 

Female 

Estimate  the  average  number  of  hours  per  week  that  you  use  a  computer  at: 
Home   School   Work   Other  Where? 

A  Answer  questions  In  this  section  if  you  have  not  \aken  a  computer  course. 

Why  haven't  you  taken  a  high  school  computer  course? 


Would  you  take  a  computer  course  in  high  schc  ")l  if  possible?  yes  no  c  .)n't  know 
Please  Explain. 


B    Answer  this  sp'     luestions  if  you  have  talcen  a  computer  science  course. 

How  many  higl-  -omputer  science  courses  have  you  taken  (including  current)? 

Please  list. 


Circle  the  work  or  phrase  that  best  describes  your  previous  computer  science  course(s)? 

I(  liked,  disliked  )  my  previous  computer  science  classes. 

Classmates  were  (  helpful,  not  helpful  )  when  I  needed  help  with  assignments. 

My  .omputer  teacher  was  usually  (  available,  busy  )  when  I  needed  help. 
Would  yoj  take  another  computer  course  in  high  school  if  possible?  yes  no  don't  know 
Please  Explain. 
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C  Please  answer  all  questions. 

After  high  school,  will  you  take  a  computer  course(s)? 
Do  you  plan  to  major  In  computer  science  in  college? 
Would  you  like  a  job  working  with  computers? 


yes  no  uon't  know 
yes  no  don't  know 
yes       no    don't  know 


Check  the  people  that  you  personally  know  who  use  computers  at  work,  home  or  school: 


Work 
Home 


Parent/Guardian 
Male  Female 


Brother  Sister 


Friends 
Male  Female 


Teachers 
Male  Female 


Brother 


Sister 


School 


Friends 
Male  Female 


Please  give  your  thoughts  about  the  following  statements: 

Some  people  think  that  there  is  a  difference  between  moles  and  females  in  how  they 
feel  about  computers. 


Some  people  think  that  it  is  difficult  to  learn  to  use  the  computer. 


Some  people  think  that  it  is  becoming  increasingly  important  to  know  how  to  use  the 
computer. 


Computer  Survey  Page  4 


Thanks  for  your  cooperation  in  answering  the  questions  on  this  survey. 
Please  moke  any  additional  comments  concerning  computer  courses 
that  you  would  like  on  this  page. 


o 
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The  Durability  of  Picture  Text  Procedural  Instructions  for 
Individuals  with  Different  Cognitive  Styles 

by 

Dennis  L.  Ausel 
George  R.  Bieger 

Indiana  University  of  Pennsylvania 
Indiana,  PA  15705 


INTRODUCTION 

Picture  text  instructions  are  often  used  to  guide  learners  through  a  variety 
of  tasks.    These  tasks  range  from  assembling  a  lawn  mower  to  operating  a  power 
plant.    Past  research  indicates  that  the  addition  of  pictures  to  text  while 
the  users  have  the  instructions  at  hand,  improves  the  comprehension  of  the 
instructions  (Crandell,  1979;  Bieger  &  Glock,  1982;  Stone  &  Glock,  1981. 
Sometimes,  however,  the  instructions  are  not  at  hand  and  the  learner  has  to 
rely  on  his/her  memory  of  the  instructions.    If  the  situation  is  life 
threatening,  recall  of  the  instructions  may  be  critical.    Recent  research 
indicates  that  the  addition  of  pictures  to  text  improves  recall  of  factual 
information    (Anglin  1986;  Rasco,  Tennyson  and  Boutwell,  1975)  however,  no 
research  could  be  found  which  indicated  whether  or  not  the  addition  of 
pictures  to  text  aided  in  the  recall  of  assembly  tasks. 

Another  variable  which  might  come  into  play  is  the  learner's  cognitive  style. 
Some  learners  with  certain  cognitive  styles  may  better  at  immediate 
comprehension  and  delayed  recall  than  other  learners  with  different  cognitive 
styles.    In  addition  their  may  be  an  interaction  of  cognitive  style  and 
picture/text  formats. 


PURPOSE  OF  THE  STUDY 

More  specifically,  the  propose  of  this  research  project  was  to  examine  whether 
or  not  the  addition  of  pictures  to  text  will  produce  significantly  better 
recall  when  the  instructions  are  not  available.    In  addition  the  study  also 
examined  the  effects  of  cognitive  style  and  the  possible  interactions  on  both 
immediate  comprehension  and  delayed  recall. 


STIMULI 

Three  sets  of  procedural  instructions  for  a  model  hand  cart  were  employed. 
One  set  was  sequential  pictures  alone,  the  second  set  was  text  alone  anJ  the 
third  set  was  a  combination  of  the  sequential  pictures  and  the  text.  All  three 
sets  of  instructions  had  been  employed  in  previous  experiments  and  had  been 
found  effective. 


37 


ERIC 


47 


COGNITIVE  STYLE 


Ninety  student  undergraduates  were  given  the  Group  Embedded  Figures  Test. 
Twenty-five  of  the  individuals  identified  as  field  independent  and  twenty-five 
of  the  individuals  identified  as  field  dependent  were  asked  to  participate  in 
the  experiment.    Of  the  fifty  individuals,  forty-se^ren  were  able  to 
participate. 


PROCEDURES 

The  forty-seven  undergraduates  who  were  classified  as  either  field  independent 
or  field  dependent  were  randomly  assigned  to  one  of  the  three  sets  of 
procedural  assembly  instructions  (i.e.  text  alone,  pictures  alone  or  pictures 
plus  text).    The  learners  were  tested  individually. 

Individually, each  participant  was  asked  to  assemble  the  model  loading  cart 
while  the  assigned  instructions  were  at  hand.    Individuals  who  assembled  a 
hand  cart  which  was  judged  functional  were  asked  to   return  28  days  later  to 
reassemble  the  model  without  the  instructions.    Two  dependent  variables  were 
employed(time  on  task  and  assembly  errors)  for  the  immediate  comprehension 
task  and  the  delayed  recall  conditions. 


RESULTS 


Assembly  crocedures  were  subdivided  into  two  categories;  those  critical  to  the 
construction  of  a  "functional"  loading  cart,  and  those  not  critical  to  the 
construction  of  a  "functional  loading  cart.   

'^J  ^Jr^J  conducted  to  examine  the  effects  of  Cognitive  Style 

(Field  Independent-Field  Dependent),  Stimulus  Type(Picture  Alone,  Text  Alone. 
Text  with  Picture),  and  Gender  (Male-Female)  on  performance,  using  accuracy 
variables  ^^""^^       critical  sub-assemblies  as  the  dependent 

Those  subjects  presented  with  Text  Alox.^  were  significantly  less  accurate  on 
f^^lt      subassemblies  than  were  subjects  who  received  eitheFthe  Pictures 

n°^^®^  "^^^  Pictures    (Text  Alone  -  13.50,  Picture  Alone  -  15.47,  Text 
with  Pictures  -  16.00).    There  were  no  other  significant  main  effects  or 
interactive  effects  pertaining  to  accuracy  on  critical  subassemblies. 

On  the  non-critical  subassemblies  there  were  no  significant  differences  for 
any  of  the  mam  effects,  nor  were  there  .jny  significant  interactions. 

Subjects  differed  significantly  in  the  total  time  needed  to  complete  the 
assembly  depending  on  which  set  of  instructions  they  received  and  as  a 
°   their  cognitive  styles.    Subjects  using  the  Picture  Alone 
instructions  completed  their  assemblies  fastest  (11.21  minutes),  with  those 

"^^^  "^u^  Pictures  performing  significantly  slower  (12.67  minutes), 
and  those  using  the  Text  Alone  being  significantly  slower  still  (13.75 
Jis^er^iin  Jt^i^'^r'^T"?"^  subjects  completed  their  assemblies  significantly 
raster  (io.61  minutes)  than  did  those  who  wero  Field-Dependent  (13.47).  There 

3H 

ERIC  4S 


were  no  significant  differences  between  males  and  females,  nor  were  there  any 
significant  interactions. 

Those  subjects  who  completed  "functional"  loading  carts  were  asked  to  return 
for  a  second  session  one  week  after  the  initial  assembly  session.    At  the 
second  session  subjects  were  asked  to  perform  the  assembly  again  without  use 
of  any  instructions  at  all.   As  in  the  initial  part  of  the  study,  time  of 
assembly  and  accuracy  on  critical  subassemblies  were  examined  as  dependent 
variables  in  the  Recall  part  of  the  study.    These  measures  of  performance  were 
examined  for  differences  attributable  to  Cognitive  Style,  original  Stimulus 
Type,  and  Gender. 

Field-Independent  subjects  performed  significantly  more  accurately  on  the 
critical  subassemblies  than  did  Field-Dependent  subjects  (12.83  vs.  8.53). 
There  were  no  other  significant  main  effects  or  interactive  effects  pertaining 
to  performance  accuracy.   As  expected,  accuracy  scores  in  the  Recall  phase  of 
the  study  were  generally  lower  than  in  the  first  part  of  the  study. 

Subjects  differed  significantly  in  the  total  time  needed  to  complete  the 
assembly  during  the  Recall  phase,  depending  on  which  set  of  instructions  they 
had  received  in  the  first  session.    Subjects  who  had  used  the  Text  Alone 
instructions  completed  their  recall  assemblies  fastest  (10.75  minutes),  with 
those  having  used  the  Picture  Alone  performing  significantly  slower  (16.42 
minutes),  and  those  having  used  the  Text  with  Picture  instructions  being 
significantly  slower  still  (20.42  minutes).    There  were  no  significant 
differences  as  a  function  of  cognitive  style  in  recall  times  nor  were  there 
significant  recall  assembly  time  differences  between  males  and  females. 

There  was  a  significant  two-way  interaction  between  Stimulus  Type  and 
Cognitive  Style,  however  this  interaction  was  judged  by  the  researchers  to  be 
due  largely  to  one  extremely  fast  assembly. 


DISCUSSION 

The  results  sumrnarized  above  indicate  that,  at  least  for  this  task,  the  type 
of  instructions  (Text,  Picture,  or  Text  with  Picture)  can  produce  significant 
differences  in  accuracy  of  performance,  but  that  the  effects  on  accuracy  of 
the  type  of  stimulus  are  not  long-lasting.    Conversely,  while  cognitive  style 
did  not  produce  significant  differences  in  performance  accuracy  in  the 
short-term,  successful  assemblers  who  were  Field-Independent  retained  their 
assembly  knowledge  better  than  their  Field-Dependent  counterparts. 

With  respect  to  speed  of  assembly,  the  effects  of  stimulus  type  are  more 
complicated.    In  the  short  term,  pictures  alone  seem  to  produce  faster 
assemblies  and  text  alone  the  slowest.    However,  in  the  long  term,  text  alone 
produced  faster  recall  assemblies. 

The  differential  effects  of  stimulus  type  and  cognitive  style  on  both  initial 
performance  and  longer  term  recall  are  worthy  of  continued  examination  in 
future  research. 
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Inte^ting  Instructional  Technology  in  Educational  Institutions: 
The  Proper  Role  for  Teachers 

Ronald  Aust.  Gary  Allen  and  Barbara  Bichelmeyer 
The  University  of  Kansas 


In  his  article.  The  Proper  Study  of  Instructional  Technology.  Robert 
Heinich  (1984)  pointed  out  that  the  evolution  of  instructional  technology 
has  been  hampered  by  its  historical  roots  in  training  teachers  to  operate 
and  apply  instructional  tools  within  the  limited  confines  of  existing 
educational  systems.  Many  educational  institutions  are  bound  by  the 
continuation  of  an  equipment-training  mentality,  even  though  today's  user 
friendly  media  and  computers  require  much  less  training  to  operate  than 
the  manually  adjusted  media  and  mainframe  computers  of  yesterday. 
Heinich  (1985)  further  contended  that  there  are  forces  within 
educational  institutions  that  perpetuate  the  craft  nature  of  teaching  and 
limit  the  development  of  those  instructional  technologies  which  could  be 
viewed  as  threats  to  the  teachers'  power  structure.  He  recommended 
that  researchers  should  investigate  the  nature  of  these  forces  and  devise 
strategies  for  expediting  more  widespread  application  of  instructional 
technology. 

In  current  educational  environments,  teachers  and  trainers  are  most 
comfortable  when  they  are  allowed  to  control  the  practice  of  their  craft 
In  the  classroom.  As  long  as  teachers  view  themselves  as  authorities  in 
developing*  selecting  and  using  instructional  support  materials,  their 
power  structure  remains  intact.  But  as  applications  of  instructional 
technology  result  in  more  self-sufficient  lessons,  which  are  in  turn 
embedded  in  more  precisely  specified  systems  of  instruction,  many 
teachers  may  become  less  effective  because  they  fear  that  their 
contribution  to  the  learning  process  is  diminishing. 

Who  should  be  first  to  encourage 

the  integration  of  instructional  technology? 

Heinich  has  identified  existing  conditions  in  educational  institutions 
which  must  change  if  the  benefits  of  instructional  technology  are  to  be 
fully  realized.  The  issues  and  potential  impact  on  students,  teachers,  and 
teacher  educators  are  substantial.  Remedies  must  be  chosen  carefully. 
We  can,  as  Heinich  has  suggested,  attempt  to  address  these  issues  at  the 
institutional  level  by  encouraging  administrators  and  government 
policymakers  to  re-examine  educational  institutions  and  adopt  cost- 
effective  instructional  systems  which  incorporate  electronically-mediated 
courses.  But.  even  if  such  efforts  are  successful  the  sudden  appearance 
of  a  number  of  legislated  electronic  courses  will  not  go  unchallenged. 
And.  these  challenges  may  only  serve  to  ingrain  the  craft  role  of  teachers 
and  trainers. 

In  a  point-of-view  statement  which  appeared  in  The  Chronicle  of 
Higher  Education.  David  Grossman  (1987)  attacked  the  incorporation  of 
electronically-produced  external  courses.  Among  other  criticisms,  he 
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argued  that  such  courses:  are  often  inferior  to  those  which  would  be  used 
by  the  institutions  that  export  them,  separate  faculty  from  course 
development,  trivialize  education,  and  threaten  the  vitality  of  the 
university  by  encouraging  a  homogenizaOon  of  InstrucUon.  Whether  or 
not  one  agrees  with  Grossman's  position,  the  political  explosiveness  of 
such  statements  must  not  be  underestimated. 

Albji  Bloom  (1987)  has  criticized  the  current  structure  of  American 
universities  for  creating  an  anarchy  of  specialized  disciplines  that 
undennines  the  foundation  of  liberal  arts  education.  Evidence  for  this 
anarchy  is  apparent  in  the  way  that  departments  within  universities  are 
becoming  more  specialized  both  in  terms  of  course  offerings  and 
resources.  Bloom  and  other  educators  are  concerned  that,  while  this 
narrowing  of  curricula  and  the  specification  of  resources  may  prepare  the 
student  for  short  term  Job  opportunities,  it  is  ultimately  crippling  their 
abilities  to  reason  in  ways  that  will  allow  them  to  adapt  to  inevitable  life 
changes  encountered  in  a  complex  society. 

In  light  of  the  current  social  climate  toward  education,  a  large-scale 
strategy  of  lobbying  administrators  and  legislators  to  incorporate  a  wide 
range  of  mediated  courses  could  very  well  backfire  in  the  form  of  a  rising 
tide  of  criticism  toward  instructional  technology.  The  problem  is  that, 
despite  the  need  for  change  a  critical  mass  of  popular  support  is 
required  before  revolutionaiy  changes  will  be  successful  in  social 
institutions.  Consider  the  policies  and  institutional  restrictions  which 
led  to  the  United  States*  involvement  in  Vietnam.  The  central  thesis  of 
Colonel  Harry  Summers'  (1982)  critical  review  of  strategies  applied 
during  the  Vietnam  war  was  that  "...a  lack  of  appreciation  of  military 
theory  and  military  strategy  -  especially  the  relationship  between  military 
strategy  and  national  policy  -  led  to  a  faulty  definition  of  the  nature  of  the 
war.  The  result  was  the  eidiaustion  of  the  Army  against  a  secondary 
guerrilla  force  and  the  ultimate  failure  of  military  strategy  to  support  the 
national  policy  of  containment  of  communist  expansion  (p.  VII)." 

Summer  further  explained  that  one  of  our  greatest  errors  was  to  allow 
U.S.  Forces  to  be  involved  in  the  internal  struggle  of  Vietnam  politics  and 
pacification.  At  a  time  v^en  the  Vietnamese  people  were  leaning  toward 
a  democratic  form  of  government,  the  infusio.i  of  U.S.  truops  to  fight 
their  war  only  served  to  alienate  the  populace,  ultimately  resulting  in 
greater  acceptance  of  Communism.  Summers  believed  that  a  more 
appropriate  strategy  would  have  been  to  seal  off  the  borders  of  Vietnam, 
thereby  preventing  the  entry  of  unstabilizing  elements  and  establishing 
an  environment  In  which  the  Vietnamese  could  bring  their  internal 
struggle  to  a  close. 

The  point  in  this  analogy  is  that  without  popular  support  from 
teachers  who  clearly  understand  the  benefits  of  instructional  technology, 
attempts  to  force  the  use  of  electronically-mediated  Instruction  in 
educational  institutions  could  be  disastrous.  The  results  could  be  the 
same  as  those  experienced  in  Vietnam.  In  the  education  scenario,  the 
secondary  guerilla  force  that  experiences  disparate  victory  would  be  the 
teachers  who  maintain  their  craft  status.  This  unseemly  scenario  would 
only  impede  the  acceptance  of  instructional  technology  while  failing  to 
serve  the  best  Interests  of  both  teachers  and  learners. 
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Teacher  A4  tit  'jdes  of  Instructional  Technologjr 

A  long  tenn  strategy  for  integrating  instructional  technology  should  be 
one  of  winning  support  at  all  levels  that  influence  the  structure  of 
educational  institutions*  In  order  to  accomplish  this,  the  potential  for 
conflict  musi  be  recognized  and  averted  as  the  involved  parties  begin  to 
posture  and  negotiate  their  positions  (Frost  and  Wilmot.  1978;  Jandt, 
1973).  Anderson  (1980)  pointed  out  that  instructional  materials  which 
have  not  been  influenced  by  teacher  input  have  a  history  of  vanishing  due 
to  lack  of  teacher  interest  or  commitment.  And  in  an  analysis  of  factors 
that  influence  the  success  of  computer-based  training  (CBT).  McCombs 
(1985)  determined  that  '    processes  of  deflning  instructor  roles  during 
implementation  and  th(    ic^mtenance  of  student/instructor  interactions 
was  critical  in  assuring;  the  success  of  CBT.  She  also  claimed  that  this 
process  must  be  done  actively  with  the  instructors  in  order  fo  gain  their 
confidence.  Once  a  critical  mass  of  teachers  advocate  the  use  of 
instructional  technology.  Heinich^s  advice  of  lobb3rlng  the  governing 
bodies  can  take  place  in  an  atmosphere  of  coalition  rather  than  conflict. 
The  logical  extension  is  that  as  the  base  of  support  grows  from  within  the 
educational  institutions,  the  favorable  climate  will  help  to  incr^ise 
acceptance  and  bolster  the  evcl  ition  of  instructional  technology. 

This  study  invesHgates  the  nature  of  teachers*  attitudes  toward  the 
integration  of  instructional  technolo^.  Our  intent  is  to  shed  light  on  the 
social  and  psychological  factors  which  contribute  to  teacher  acceptance 
and /or  rejection  of  instructional  tec  imology.  Once  these  factors  are  more 
completely  understood,  they  may  serve  as  guides  for  curricula  decision 
making,  instructional  design  strategies  and  the  evolution  of  institutional 
policy. 

Method:  Naturali:^  Inquiry 

Because  the  components  of  teachers'  belief  structures  were  unknown 
and  iMghly  subjective,  a  naturalistic  p  iradigm  was  used  as  the  guiding 
research  design.  The  naturalistic  methof'    .gy  is  an  emergent  design 
which  is  particularly  useful  in  studies  whe.e  the  definition  of  issues  is 
vague  at  the  outset,  and  researchers  are  interested  in  revealing  the 
parameters  of  the  issues  and  the  factors  effiecting  tiiose  issues.  The 
naturalistic  inquiry  adheres  to  the  rigor  of  tandem  data  collection 
techniques.  Specifically,  this  meant  tfie  use  of  structured  interviews  and 
the  factor  analysis  of  an  attitude  response  form.  Ouba,  (1981)  encouraged 
the  combination  of  a  rationalistic  approach  (attUude  scale)  with  a 
naturalistic  approach  (interviews)  in  qurlitative  research. 

The  interview  phase  of  the  qualitative  analysis  began  with  the  following 
assumptions: 

1.  The  data  would  be  value-laden  because  they  are  based  primarily  on  the 
belief  structures  of  educators,  rather  than  on  facts  gathered  by 
empirical  research. 


2.  Multiple  realities  would  be  expressed  by  the  various  educators,  in  that 
their  views  about  the  need  for  and  use  of  technology  in  the  classroom 
would  include  a  number  of  varying  be)*efs  and  opinions. 

3.  Hirough  verbal  communication,  the  human  can  be  a  legitimate 
instrument  for  data  collection. 

4.  During  the  interview  phase  of  the  research,  a  small,  purposive  sample 
would  be  acceptable  because  replication  of  data  was  the  criterion  to  be 
achieved. 

5.  Boundaries  of  the  interviews  were  determined  by  the  focus  on  factors 
which  influence  the  acceptance  and/or  rejection  of  instnjctional 
technology. 

6.  Data  from  the  interview  stage  of  the  research  would  be  used  to  create 
a  comprehensive  set  of  items  as  a  basis  for  developing  the  attitude 
scale. 

7.  Factor  analysis  of  the  attitude  scale  would  be  used  in  considering  the 
appro,  riateness  cf  the  categories  idenUfied  through  the  interviews. 

The  interviews 

Five  professional  public  school  educators  with  varying  numbers  of 
years  of  experience  and  different  content  area  expertise  were 
interviewed.  Each  interview  lasted  approximately  30  minutes  and  was 
conducted  following  a  similar  outline.  The  number  of  interviews 
conducted  in  this  phase  of  the  study  was  determined  by  the  amount  of 
replication  of  data  collected  in  each  of  the  interviews. 

At  the  beginning  of  each  interview,  educators  were  asked  to  fill  out  a 
consent  and  demographics  form  that  idenUfied:  number  of  years  of 
teaching  experience,  grade  levels  taught  and  types  of  technology  used  for 
professional  purposes. 

After  the  educators  completed  the  demographics  form,  a  few  minutes 
were  spent  with  introducUons  and  getUng  acquainted.  The  introaucUon 
concluded  as  the  interviewer  stated  the  purpose  and  procedure  for  the 
remaining  portion  of  the  interview.  Thu  interviewer  stated  that  the 
reason  fc-  the  interview  was  to  get  ideas  from  the  educator  about  how  he 
or  she  ^eit  instrucUonal  technology  should  be  used  in  the  classroom. 

At  this  point,  the  educator  was  astojd  to  define  liis  or  her  concept  of 
instrucUonal  technology.  This  step  w£is  included  in  the  interview  process 
to  make  sure  that  both  the  interviewer  and  the  educator  had  a  similar 
understanding  of  the  general  concept  of  insUrucUonal  technology  before 
proceeding  with  any  further  invesUgation  of  the  educator's  beliefs  about 
its  value  and  use  in  the  classroom.  The  worlcing  deflniUon  of 
insU  icUonal  technology  used  for  this  study  was:  "The  discipline  of 
creating,  evaluaUng  and  disseminaUng  educaUonal  materials  through 
various  forms  of  media  including  (but  not  limited  to):  sound-slide  shows, 
overhead  projecUons.  bulletin  boards,  televisioii.  films  and  computers."  If 
an  educator  would  have  given  a  deflniUon  that  clui  not  adhere  to  the 
working  definiUon.  the  interviewer  AAould  have  suggested  a  definition 
more  closely  suited  to  the  working  definiUon.  However,  this  logisUcal 
problem  did  not  £irise  during  the  interviews. 
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ihe  main  portion  of  the  interview  consisted  of  seven  questions,  which 
were  asked  in  the  same  order  to  each  of  the  educators.  The  questions 
were: 

A)  In  your  professional  situation,  how  do  you  typically  use 
instructional  technology? 

B)  What  are  the  advantages  of  using  instructional  technology? 

C)  What  are  the  disadvantages  of  using  instructional  technology? 

D)  What  are  the  differences  between  teachers  who  don't  use 
instructional  technology  and  teachers  who  do? 

E)  In  your  picture  of  the  ideal  situation,  what  types  of  instructional 
technology  would  be  available  to  you  to  help  you  reach  your 
students? 

F)  As  more  sophisticated  types  of  instructional  technology  become 
available,  what  do  you  imagine  the  role  of  the  classroom  teacher 
wil'  be  in  the  future? 

G)  What  is  your  opinion  about  the  role  teachers  should  take  in 

designing  instructional  technology  and  v/hy?* 
*  This  question  was  prefaced  with  the  explanation  of  the  following  debate: 
There  Is  a  debate  In  education  toaay  about  the  role  that  teachers  should  take  In 
designing  fully  mediated  instruction.  Some  people  say  that  teachers  should  be  ihe 
principal  designers  of  sofbvare  and  materials  to  be  used  with  instructional 
technology,  becajuse  they  are  the  ones  who  work  most  closely  with  students  and 
they  are  most  aware  of  students'  needs.  There  are  ottvers  who  think  that 
instructional  software  and  materials  should  be  developed  by  fuU-ttme 
instructional  designers  and  that  a  teachefs  role  should  not  be  as  a  developer  of 
instructional  materials  but  as  one  who  implements  the  instructional  designers' 
products  in  the  classroom  environment 

Analysis  of  the  interviews 

Based  on  the  data  collected  in  the  interview  phase,  categories  were 
created  to  reflect  these  educators*  expressed  sentiments  about 
instructional  technology.  After  each  interview  was  completed,  data  from 
tlie  interview  were  chunked  into  separate  topic  categories  and  each  unit 
of  data  was  placed  on  a  3"x5"  note  card  with  a  numerical  code  that 
identified  the  source  of  the  data,  and  a  working  title  to  deiiote  the  type  of 
data  on  the  card.  After  the  completion  of  all  U  rcrviewp,  cards  were 
sorted  into  categories  of  similar  data,  and  names  were  developed  for  each 
unit  of  similar  data.  The  categories  were  called  factors  and  opposing 
positions  were  identified  within  each  factor.  The  factors  identified  were: 
Entertainment  value  represents  the  belief  that  fully  mediated 
instruction  is  primarily  entertainment  and  therefore  non- 
educational,  llie  opposing  belief  is  that  students  learn  a 
considerable  amount  from  fully  mediated  instruction  because  they 
are  interested  in  what  they  observe. 
Teacher  displacement  represents  the  belief  that  teachers*  classroom 
duties  will  be  displaced  by  instructional  technology.  The  opposing 
belief  is  that  instructional  technology  will  continue  to  be  a  tool,  albeit 
a  more  advanced  one,  for  teachers  to  utilize  in  their  classrooms. 
Need  for  innovation  acknowledges  that,  due  to  differing  personality 
traits,  some  teachers  want  to  be  at  the  forefront  of  educational 
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change.  The  opposing  belief  is  that  many  teachers  are  comfortable 
with  the  status  quo  in  education. 

Decline  qf  the  printed  word  represents  the  belief  that  instructional 
technology  is  contributing  to  the  loss  of  the  written  word.  The 
opposing  belief  is  that  instructional  technology  merely  emphasizes 
different  critical  thinking  skills  for  processing  information. 

Intransigent  factor  is  based  on  the  belief  that  certain  (often  described 
as  older)  teachers  are  set  in  their  ways  and  less  willing  to 
e}q>eriment  with  advances  in  instructional  technology. 

Teacher  control  is  based  on  the  belief  that  the  teacher  should  dominate 
the  classroom  and  dictate  lessons  to  students.  The  opposing  belief  is 
that  the  teacher  is  viewed  as  a  facilitator  who  helps  students  to 
become  independent  learners  and  to  make  their  own  decisions. 

Dehumanization  represents  the  belief  that  instructional  technology  is 
mechanized,  dry,  inflexible  and  unresponsive  to  students.  The 
opposing  belief  is  that  instructional  technology  produces  a  more 
thoroughly  thought-out  and  systematic  approach  to  lessons  than  any 
single  teacher  can  and  therefore  better  meets  the  needs  of  individual 
learners. 

Content  specific  refers  to  the  belief  that  some  content  areas  are 

appropriate  for  use  of  instructional  technology  while  many  others  are 
not.  The  opposing  belief  is  that  all  content  areas  can  benefit  in  some 
way  from  using  instru'^tional  technology. 

Techno-literacy  represents  the  belief  that  some  teachers  are  naturally 
more  comfortable  with  using  technical  equipment  to  aid  instruction. 
The  opposing  belief  is  that  many  teachers  do  not  understand  how 
technical  machines  work  and  that  they  should  not  be  force-i  to  learn 
about  them. 

Prepare  for  the  future  is  the  belief  that  instructional  technology  should 
be  a  primary  consideration  in  school  expenditures  because  it  is  the 
wave  of  the  future.  The  opposing  belief  is  that  instructional 
technology  should  be  a  secondary  consideration  because  it  is 
futuristic  and  educators  need  to  concentrate  on  meeting  the  needs  of 
students  today.  fThis  factor  was  based  on  the  question  of  allocation  of 
monetary  resources.) 

Inadequate  software  refers  to  the  concern  that  instructional  technolo^jy 
is  not  ready  for  integration  into  classrooms  because  there  is  not 
much  effective  software  available.  The  opposing  belief  is  that 
instructional  technology  ii  ready  for  the  classroom  just  as  soon  as 
teachers  are  willing  to  make  the  effort  to  design  programs  for  their 
own  particular  needs. 

Limited  time  represents  the  assumption  that,  given  limited  time  and 
resources,  teachers  should  spend  their  energy  working  with 
students.  The  opposing  belief  is  that,  given  limited  Ume  and 
resources,  teachers  should  attempt  to  make  lessons  as  creative, 
interesting  and  understandable  as  possible,  and  use  of  instructional 
technology  can  aid  this  process. 
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Development  of  the  survey  instrument 


After  the  initial  review  of  the  interview  reports  and  categorization  of 
factors,  the  first  draft  of  the  survey  was  developed  according  to  the 
guidelines  described  in  the  Survey  Questions:  HandcrcLfting  the 
Standardtzed  Questlornate  (Converse  and  Presser.  1986). 

A  panel  of  three  experienced  educators  who  were  familiar  with  the 
study  and  results  of  the  interviews  assembled  to  create  the  items  for  the 
initial  draft  of  the  survey.  Each  member  worked  independently  to  write 
10  Ukert  scale  items  for  each  of  12  different  factors  that  were  iden tilled 
from  a  pattem  analysis  of  the  interview  Information.  The  items  were 
assembled  and  produced  as  a  numbered  list  of  items.  This  list  of 
numbered  items  was  then  independently  reviewed  by  each  member  of 
the  panel.  The  panel  met  again  as  a  gioup  to  review  the  independent 
critiques  and  agreed  on  the  final  list  of  120  items.  Finally,  the  order  that 
the  items  would  appear  on  the  test  form  was  determined  using  a  random 
number  generator  and  the  version  of  the  survey  that  was  used  in  this 
study  was  produced. 

The  Teacher  Attitudes  of  Instructional  Technology  (TAIT)  survey 
included  10  items  for  each  of  the  12  factors  identified  during  the 
interviewing  phase.  Responses  to  each  item  ?re  marked  on  a  5- point  Likert 
scale.  A  response  of  1  indicates  strong  agreement  with  the  statement.  3  is  a 
neutral  response  and  5  indicates  strong  disagreement.  A  majority  of  the 
items  (81)  directly  referred  to  opinions  about  the  use  of  fully  mediated 
instruction.  Directions  on  the  first  page  of  the  TATT  survey  included 

definitions  for  the  following  terms: 
InstrucUoncd  Support  Media  —  Educational  mateilals  which  are  used  by  teachers  to 
present  ideas.  These  includes  overhead  transparencies,  films,  television  programs, 
slides  and  computer  software  when  the  materials  are  used  to  assist  the  teacher  in 
delivering  lessons. 

Fully  Mediated  Instruction  —  Lessons  or  courses  which  are  presented  by  media  wilhoui 
ai^  required  assistance  from  a  teacher.  These  include  courses  which  are  delivered 
entirely  on  television  or  computers.  Fully  mediated  instruction  is  distinct  from 
instructional  support  materials  because  it  is  designed  so  that  it  can  be  used  without  any 
Intervention  from  a  teacher. 

Administering  the  TAIT  Survev 

rhe  survey  was  administered  during  the  begirming  sessions  of  graduate 
education  courses  held  during  the  1988  Summer  and  Fall  semesters  at 
the  University  of  Kansas.  Observers  explained  that  responses  would  be 
anonymous  and  that  completion  of  the  surveys  was  voluntary.  The 
subjects  were  asked  to  review  the  directions,  paying  special  attention  to 
the  definition  of  terms.  After  responding  to  appropriate  questions 
pertaining  to  the  directions  or  definitions*  the  observer  instructed  the 
subjects  to  complete  the  survey. 

Of  the  146  subjects  who  completed  the  survey.  36  were  males  and 
1 10  were  females.  The  graduate  education  students  represented  a  broad 
range  of  educators*  in<;luding  those  prepared  for  both  elementary  and 
secondary  levels,  a  variety  of  content  areas  and  international  education. 
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Factor  Analysts 


The  objective  of  a  factor  analysis  is  to  reduce  a  large  set  of  variables  to 
a  smaller  set  categories  or  factors  that  reflect  the  observed  results 
(Anderson,  Basilevsky,  Hum,  1983).  The  Handbook  of  Survey  Research 
(Rossi,  Wright,  and  Anderson,  1983)  was  used  to  begin  the  process  of 
reducing  the  initial  set  of  120  items  down  to  a  manageable  number.  The 
SPSSx  statistical  package  was  used  in  adhering  to  the  following 
procedure  described  by  Bohmstedt  (1983.  p.  102). 

1.  Conduct  an  exploratory  factor  analysis  using  the  Maximum  Likelihood 
procedure. 

2.  Decide  on  the  number  of  factors  needed  to  explain  the  covariation 
among  the  items  using  both  the  X2  and  Tucker-Lewis  statistics  for 
reference. 

3.  Examine  the  Eigen  values  of  the  rotated  and  unrotated  solutions 
when  m  >  1  in  order  to  determine  if  the  items  are  meaningful  or 
unwanted. 

4.  Remove  the  items  that  are  poorly  related  or  represent  more  than 
one  domain. 

5.  Use  a  confirmatory  analysis  (Varimax)  to  refactor  the  remaining 
items  to  verify  that  they  are  congeneric. 

Results  from  the  TAIT  Survey 

The  factor  analysis  resulted  in  the  identification  of  five  prevalent 
factors  that  concern  the  use  of  fully  mediated  instruction.  After 
reviewing  the  items  that  were  correlated  with  each  factor,  a 
representative  title  was  established  for  each  factor.  Some  items  were 
recoded  so  that  the  factor  means  would  accurately  represent  opinions 
towards  the  concept  expressed  in  the  factor's  title.  For  example,  one  of 
the  items  that  correlated  with  Teacher  Involvement  (factor  four)  was  - 
The  inittattve  to  usefiilly  mediated  instruction  should  come  from 
teachers  ^=2.16),  and  another  factor  four  item  was.  --  The  main  reason 
that  some  teachers  don't  usejidly  mediated  instruction  is  because  they 
are  too  lazy  to  make  the  ejfort  (M=3.93).  In  this  case,  the  second  item 
was  recoded  so  that  the  1  responses  (strong  agreement)  became  5s 
(strong  disagreement),  the  5  responses  became  Is  and  so  forth. 
Recoding  of  the  second  item  in  determining  the  factor  four  mean  served 
to  more  accurately  reflect  the  opinions  regarding  the  willingness  of 
teachers  to  become  involved  in  using  fully  mediated  instruction. 
Correlations  for  the  items  associated  with  these  five  factors  ranged  from 
.38  to  .84.  Following  is  a  list  of  the  factors  and  representative  survey 
items  for  each  factor: 

1.  Curriculum  Content  (M=2.21.  SD=1.09).  On  the  5-point  scale. 

teachers  agreed  that  curricula  content  areas  like  math  and  reading  can " 
be  effiectively  taught  using  fully  mediated  methods.  However,  this 
belief  varied  somewhat  between  content  areas.  For  example,  there 
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was  agreement  that.  English  is  an  appropriate  content  area  for  Jully 
mediated  tnstruction  (M=2.7.  SD=1.3).  but  there  was  even  greater 
agreement  with  the  statement  that.  Math  is  an  appropriate  content 
area  for  Jiilly  mediated  tnstruction  (M=2.2.  SD=1.2]. 

2.  Extension  qf  traditional  methods  (M=2.17.  SD=L15).  The  findings 
indicated  an  acceptance  of  the  belief  that  fully  mediated  instruction 
can  successfully  augment  traditional  methods  of  instruction.  For 
example,  there  was  disagreement  with  the  statement.  Fully  mediated 
tnstruction  does  not  coexist  well  with  traditional  educational  methods 
(M=3.71.  Sa=107).  And.  this  notion  correlated  with  the  belief  that 
Fully  mediated  tnstruction  should  go  beyond  the  scope  of  individual 
lessons  (M=2.18.  SD=1.04l. 

J.  Integration  of  Instructional  Technology  fM=1.63.  SD=.93).  This 
factor  addresses  teachers*  beliefs  about  how  instructional  technology 
can  be  used  to  augment  instruction  and  who  should  be  involved  in  its 
development.  The  findings  indicate  strong  support  for  the  belief  that 
integration  with  other  classroom  teaching  techniques  is  the  answer. 
The  greatest  agreement  among  aU  items  was  to  the  statement: 
Instructional  support  media  compliments  the  teachefs  role  in 
educating  students  ^=1.45.  SD=.651.  And.  this  group  of  educators 
would  like  to  be  involved  in  implementing  integration.  —  I  would  be 
willing  to  integrate  instructional  support  media  into  my  lesson  plans 
(M=1.57.  SD=.73). 

4.  Teacher  Initiatiuc  (M=2.1.  SD=  1.01).  This  factor  expands  on  the 
notion  that  educators  are  willing  to  be  involved  in  the  integration  of 
instructional  technology.  A  reasonable  explanation  for  educators* 
expressed  belief  that.  The  inttiaUve  to  use  fully  mediated  instruction 
should  come  from  teachers  (M=2.16.  SD=.96).  is  that.  Teachers  have 
more  faith  in  instruction  of  their  own  design  (M=2.19.  SD=1.0). 

5.  What  Does  the  Future  Hold  (M=2.52.  SD=1. 10).  As  the  title  of  this 
factor  implies,  some  soothsaying  is  needed  here.  Those  subjects  who 
agreed  with  the  statement  that.  Few  teachers  will  be  displaced  by  fully 
mediated  instruction  in  the  future  {M=2.38.  SO=l.l)  also  tended  to 
agree  with  the  statement  that  Fully  mediated  instruction  is  a  more 
systematic  approach  to  instruction  than  traditional  classroom 
instruction  (M=2.65.  SD=1.09).  Is  this  a  belief  that  traditional 
instruction  needs  to  become  more  systematic?  A  condemnation 
suggesting  that  instructional  technology  is  impersonal?  A  realization 
that  certain  aspects  of  instruction  need  a  highly  systematic  approach 
which  can  be  best  served  by  instructional  technology?  Or.  is  it  a 
reflection  of  the  uncertainty  of  what  lies  ahead  ^or  instructional 
technology  and  the  careers  of  educators? 
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Conclusions: 


Naturalistic  research  methodology  was  useful  in  revealing  the 
dimensions  of  the  belief  structures  through  which  teachers  form  opinions 
about  the  development  and  use  of  instructional  technology.  Our  initial 
subjective  notions  were  expanded  through  the  interview  sessions,  which 
were  the  basis  for  the  formation  of  the  first  set  of  categories.  Analysis  of 
ihe  survey  provided  a  means  of  sampling  a  larger  pool  of  the  population 
and  resulted  in  a  recasting  of  some  earlier  formed  categories. 

Hie  general  conclusion  is  that  most  educators  are  excited  about 
applying  instrucUonal  technology  in  the  classroom  and  that  they  want  to 
be  involved  In  both  the  development  and  application  phases.  Results 
from  the  sample  used  for  this  f  tudy  did  not  suggest  an  undercurrent  of 
resistance  toward  Instructiona'  technology.  However,  this  conclusion 
should  be  tempered  by  a  recognition  that  the  sample  consisted  of 
educators  who  had  elected  to  pursue  graduate  education,  and  most  of  the 
participants  lived  near  a  majoi  university  or  a  large  metropolitsm  area.  A 
broad  sampling  of  classroom  teachers  in  both  rural  and  urban  districts 
may  reveal  somewhat  more  tentative  opinions  toward  instructional 
technology. 

For  the  most  part,  the  belief  categories  detennined  by  the  factor 
analysis  confirmed  assumptions  about  the  contributing  factors  drawn 
from  the  Interviews.  Opinions  that  instructional  technology  is  more 
appropriate  for  some  content  areas,  e.g.  Math  and  Science,  than  others. 
e.g.  English,  prevail.  Although  there  are  different  levels  of  agreement, 
educators  appear  to  believe  that  the  use  of  instructional  technology  is 
appropriate  for  all  content  areas. 

When  asked  the  quesUon,  How  should  instructional  technology  be 
brought  into  the  curricula?  the  overwhelming  response  is  through 
integration.  Teachers  seem  to  recognize  that  fully  mediated  instruction 
has  the  potenUal  to  deal  with  a  broad  base  of  curricula  content  and  they 
believe  that  it  is  best  used  In  conjunction  with  traditional  approaches  to 
teaching.  They  appear  to  be  convinced  that  computers  and  other 
informational,  technologies  will  continue  to  shape  all  aspects  of  society 
and  they  want  to  play  significant  roles  in  preparing  students  with  the 
necessary  skills  for  adapting  to  the  technolo^cal  changes  which  are  sure 
to  come  in  the  future. 

Teachers  express  a  willingness  to  extend  the  effort  necessary  for 
learning  how  to  develop  and  apply  instrucUonal  technology.  However, 
hey  are  concerned  that  they  dor't  have  enou^  time  to  learn  all  they 
leed  to  know.  And,  they  will  £     agly  oppose  efforts  to  channel  teacher 
salary  ftinds  to  the  developmeni  .  instrucUonal  technology.  Out  of  the 
120  items  In  the  TAIT  survey,  the  greatest  disagreement  (M=4.37, 
Sfi=.95)  was  to  the  statement.  Some  of  the  money  now  designated  Jor 
teachefs  salaries  should  be  spent  on  acquiring  good  JixUy  mediated 
instruction.  Teachers  are  willing  to  extend  the  effort  necessay  to  apply 
instrucUonal  technology  in  their  teaching  but  when  it  comes  to  their 
salaries,  hands  off. 
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Recommendatloiui 


Teachers  are  the  foundation  of  our  educational  institutions.  They 
shape  the  instruction  and  activities  in  the  classroom  and  they  are  role 
models  for  our  students,  instructional  technology  will  not  reach  its  full 
potential  without  their  support.  Some  who  ponder  the  future  of 
educational  institutions  in  light  of  instructional  technology  (Heinich, 
1985;  Perlman  1988)  believe  that  a  restructuring  of  the  systems  will  be 
needed  before  any  significant  advances  are  realized.  Revolutionary 
changes  may  be  needed,  hvt  such  changes  must  be  sensitive  to  the  needs 
and  aspirations  of  teachers.  As  Heinich  emphasized,  even  well-designed 
instructional  technology  can  be  sabotaged  by  a  disinterested  teacher. 

The  reason  that  teachers  strongly  disagree  with  statements  regarding 
the  use  of  teacher  salary  funds  for  instructional  technology  may  have 
more  to  do  with  their  dignity  than  their  pocketbook.  Strategies  for 
incorporating  and  training  in'the  use  of  technology  must  empower  the 
teachers  in  ways  that  give  them  a  sense  of  control  over  their  own 
desUnles  (Prymler,  1987;  Grady  1988;  Maeroff,  1988).  Teacher 
education  programs  should  include  required  courses  which  focus  on 
topics  for  integrating  instructional  technology  throughout  grade  levels 
and  content  areas  -  not  those  that  are  restricted  to  programming  or 
production  techniques  (see  for  example  Bruder,  1989;  Rossenberg,  S  & 
Bitter,  G.  (1988)). 

Teachers  should  also  view  themselves  as  active  participants  in  the 
evolution  of  instructional  technology.  One  way  to  empower  teachers  is  to 
provide  greater  teacher  control  features  in  instructional  software.  The 
teachers  In  this  study  strongly  agreed  that,  h^ucattonal  software  should 
be  designed  to  aUow  for  modifications  by  teachers  (M=1.64  SD=.88). 
Interactive  courseware  should  be  designed  to  allow  teachers  to  control 
such  features  as  time,  difficulty  level,  feedback,  questions  and  certain 
aspects  of  content. 

An  open  environment  for  exchanging  ideas  between  teachers  and 
developers  of  instructional  courseware  should  be  developed.  Consider 
how  the  introduction  of  the  personal  computer  has  changed  attitudes 
toward  the  application  of  technology  to  management  problems 
encountered  in  business  and  industry.  The  roles  of  millions  of 
professionals  have  gone  through  significant  changes  as  the  result  of 
computerizing  the  workplace.  In  many  cases,  these  changing  roles  are 
being  adopted  with  enthusiasm,  not  antagonism.  Secretaries  who  have 
experience  with  word  processors  are  not  ^-equestikig  that  their 
typewriters  be  returned. 

In  some  business  applications,  personal  computers  are  simply  tools  for 
assisting  workers  in  more  efficiently  accomplishing  existing  aspects  of 
their  Job,  such  as  word  processing.  They  serve  in  much  the  same  way 
that  media  tools  serve  the  craft  nature  of  teaching.  However,  as  personal 
computers  begin  to  appear  on  the  desks  of  middle  management,  a  much 
broader  impact  on  business  institutions  is  emerging  in  the  form  of 
technological  approaches  to  problem  solving  (Scully,  1987). 
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The  middle  manager's  romance  with  personal  computers  began  with 
recognition  of  the  power  of  databases  for  keeping  track  of  employees  and 
spreadsheets  for  controlling  accounts.  But  recently,  middle  managers  are 
beginning  to  use  project  management  and  advanced  spreadsheet  software 
for  decision-making,  long-term  planning  and  forecasting.  In  this  way,  the 
personal  computer  has  acted  as  a  conduit  through  which  more  systematic 
procedures  are  applied  to  solving  the  complex  problems  that  successful 
business  must  overcome  as  they  enter  the  information  age.  As  more 
advanced  and  more  user-friendly  aut^ioring  software  becomes  available  to 
educators,  the  personal  computer  may  serve  a  similar  function  in 
educational  institutions  by  developing  a  broader  acceptance  of 
instructional  technology. 

If  David  Pearhnen's  (1988)  prognosis  for  the  future  of  educational 
Institutions  is  realized,  there  will  be  new  and  expanded  educational 
opportunities  in  such  disciplines  as  learner  analysis,  courseware 
development,  home  or  rural-based  distance  learning  and  educational 
evaluation.  The  obvious  candidates  for  these  new  positions  come  from 
the  ranks  of  those  who  are  currently  teaching  in  our  schools. 
Mechanisms  for  allowing  teachers  to  develop  instrucUonal  technology 
should  not  come  only  from  universities,  there  must  be  a  greater  emphasis 
on  professional  development  from  school  systems  and  from  state 
education  offices.  When  teachers  also  become  developers,  they  are  Ukely 
to  take  a  more  personal  interest  in  the  quality  of  instrucnonal  technology 
and  thereby  become  more  conscientious  critics.  Educational  institutions 
can  then  focus  on  their  primary  task,  and  become  places  where  teachers 
are  united  in  efforts  to  apply  instructional  technology  to  the 
enhancement  of  learning  throughout  the  curricula. 
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An  Eoleotio  Qualitative-Quantitativ*  Resaareh  Design 
for  the  study  of  Affective-Cognitive  Learning 

by  Darrell  G.  Beauchamp  and  Roberts  A.  Braden 


Whenever  a  research  question  or  set  of  questions  calls 
for  investigation  of  complex  phenomena  there  is  the  distinct 
possibility  that  no  single  research  technique  will  provide  a 
c:lear  answer  or  set  of  answers.    Experimental  research  designs 
generally  call  for  the  isolation    of  discrete  variables  and 
proceed  from  there  through  appropriate  data  collection  and 
manipulation  routines  leading  to  results  upon  which  we  can 
place  a  high  level  of  confidence.    Usually  when  we  wish  to  ex- 
plore the  interactive  relationships  of  two  variables  we  simply 
stabilize  one  variable  and  manipulate  the  amount  of  variation 
of  the  other  —  all  the  while  observing  the  results,    when  we 
begin  to  operate  in  three  or  more  variables,  however,  that 
simplistic  dependent  variable  vs  independent  variable  approach 
breaks  down.    In  effect,  for  three  variables  we  have  at  least 
two  and  possibly  three  dependent  vs.  independent  comparisons. 
For  four  or  more  variables,  the. number  of  potential  two- 
variable  comparisons  increases  geometrically  as  the  number  of 
total  variables  increases  (the  sequence  is  1,  3,  6,  10,  15, 
21,  28,  etc.).    And  each  additional  two-variable  comparison 
that  is  to  be  investigated  warrants  consideration  for  unique 
experimental  and/or  data  collection  treatment.    Of  course  none 
of  this  is  new  to  research  scholars,  but  the  impact  of  running 
what  amounts  to  several  concurrent,  but  procedurally  different 
experiments  tends  to  mitigate  against  examination  of  multi- 
variable  questions  unless  similar  and  compatible  procedures 
are  contemplated. 

Occasionally,  though,  more  than  two  dissimilar  variables 
cry  out  to  be  investigated  together.  This  paper  describes  a 
research  design  for  considering  the  effects  of  visual  and 
verbal  variables  on  both  affective  response  and  cognitive 
achievement.  The  dissimilarities  in  techniques  for  measuring 
affective  response  and  cognitive  achievement  necessitated  the 
creation  of  an  eclectic  design. 


Eclectic  Design 

Quantitative  studies  dominate  the  methodology  of  educa- 
tional technology  rese-^rch.    Robinson  and  Ong  (1988)  reviewed 
the  methods  employed  by  the  authors  of  research  journal  ar- 
ticles from  ESU  and  ilJB,  published  during  the  decade  1976-86, 
and  found  that  only  65  of  216  studies  (30%)  utilized  methods 
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other  than  experimental  or  survey.    Experimental  methods  alone 
accounted  Jor  57%  of  all  studies.    Altogether,  quantitative 
methods  were  used  for  about  three  out  of  evexy  four  studies. 
Still,  a  fourth  of  all  studies  strayed  from  hard  line  quan- 
titative approaches,  and  that  percentage  may  be  growing.  A 
dozen  or  more  alternative  methods  have  appeared  that  each  have 
their  advocates.    Importantly,  in  the  smorgasbord  of  now- 
acceptable  research  techniques  we  find  approaches  for  the 
study  of  qualitative  questions. 

Like  the  study  at  hand,  many  -  maybe  most  -  qualitative 
studies  also  have  a  natural  quantitative  component.     In  a 
simple  example,  even  those  things  that  must  be  measuisd  ac- 
cording to  their  value  (quality)  can  also  be  counted 
(quantified).    Even  with  naturalistic  inquiry,  which  presumes 
that  the  investigator  collect  data  without  a  priori  assump- 
tions, there  is  no  theoretical  exclusion  of  num«rieal  data  in 
the  collection  effort.    Consequently  the  naturalistic  study 
may  very  well  rely  upon  statistical  techniques  for  the  ul- 
timate analysis  of  some  or  all  of  the  information  collected. 
Furthermore,  there  is  nothing  to  infer  that  the  naturalistic 
researcher  will  not  automatically  add  even  an  experimental 
episode  when  the  evolving  structure  of  a  study  points  to  the 
need  for  quantitative  analysis  to  fulfill  the  nerds  of  the 
broader  inquiry,    indeed,  the  researcher's  option  to  combine 
elements  from  the  various  classic  research  designs    may  drive 
the  research  design  processes  of  the  future. 

None  of  this  is  to  suggest  that  whe  authors  are  herein 
espousing  circumvention  of  sound  procedures  and  abandonment  of 
reason-based  good  practice.    To  the  contrary.    The  clear  im- 
plication is  that  good  practice  demands  that  research  designs 
be  like  good  food  recipas.    We  must  call  for  every  ingredient 
that  is  needed.    Thus  as  the  skillful  cook  combines  the  recipe 
for  crust  with  the  recipe  for  pie  filling,  the  skillful  re- 
searcher can  combine  the  design  elements  for  a  qualitative 
study  that  is  the  pie  shell  into  which  s/he  pours  the  results 
Obtained  from  an  investigation  based  uPon  a  quantitative 
design.    These  authors  believe  that  they  have  cooked  up  such  a 
dish  (as  have  many,  many  other  researchers  before  them) . 
Rather  than  call  the  design  a  recipe,  however,  the  authors 
have  chosen  to  refer  to  the  inter eaving  of  functionally  dif- 
ferent design  elements  as  eclect         Eclecticism  has  clear  ad- 
vantages —  it  allows  one  to  boi  ow  the  best  ideas  and  leave 
out  the  worst,  and  it  is  bereft  of  any  baggage  that  requires 
the  practicing  eclectic  to  be  t*>e  advocate  of  any    one  of  the 
competing  philosophies.    The  authors  are  not  spokespersons  for 
the  experimental  method  which  was  used  extensively  in  the 
study  reported  here;  nor  are  they  spokespersons  for  quasi- 
experimental,  quasi-naturalistic  or  naturalistic  methods  which 
also  played  a  part  in  the  study. 
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Design  Imperatives 


When  the  authors  sat  down  to  discuss  this  study  two  years 
ago,  the  objective  seemed  clear  and  simple*    There  was  a 
monumental  hole  in  society's  knowledge  base  concerning  the 
bridge  between  affective  response  and  cogni^.ive  learning.  The 
authors  had  collaborated  on  an  article  (Braden  and  Beauchamp, 
1987)  which  had  toyed  with  some  theory  about  display  of  infor- 
mation along  a  visual -verbal  continuum  —  a  heuristic  piece 
inspired  by  Wileman's  Typology  (1980) .      An  obvious  limitation 
of  the  Wileman  continuum  was  that  it  applied  only  to  messages 
conveyed  visually.    Also,  even  the  end  of  the  spectrum  that 
was  represented  by  totally  pictorial  visual  material  had  been 
studied  primarily  for  it;s  utility  in  delivering  cognitive  con- 
cepts.   From  a  sensory  (Standpoint,  the  earlier  work  had  been 
unidirensional ,  dealing  only  with  the  sense  of  sight.  Intel- 
lectually the  earlier  work  had  beer  unidimensional,  dealing 
only  with  knowing  (cognition)  and  paying  scant  attention  to 
appreciation,  emotion  and  feeling  (affect). 

The  first  design  imperative  for  this  study  was  that  both 
of  the  primary  learning  senses  (sight  and  hearing)  be  in- 
cluded.   The  second  imperative  was  to  extend  the  inquiry  into 
both  the  the  affective  and  cognitive  domains.    The  third 
design  imperative  was  that  tne  final  design  must  have  holistic 
integrity.     In  that  sense,  complexity  could  not  be  allowed  to 
obscure  the  value  of  individual  research  procedures,  nor  could 
the  detail  of  any  technique  command  so  much  attention  as  to 
overwhelm  the  project  as  a  whole.     In  other  words,  everything 
had  to  complement  everything  else. 

The  fourth  design  imperative  was  that  every  effort  would 
be  made  to  prevent  this  study  from  turning  into  another 
"Medium  A  vs  Medi*''^  B"  study.    The  very  idea  that  instruc- 
tional delivery  systeiiTS  such  as  slide  +  tape  programs  increase 
learning  is  one  not  widely  accepted  by  all  authors  (Clark, 
1907;  Simonson  &  Burch,  1975;  Simonson,  1987).     Perhaps  Clark 
overstated  the  case  when  he  saM  that  media  were  "mere 
vehicles  that  deliver  instruction"  and  insisted  that  "they  do 
not  influence  student  achievement  any  more  than  the  truck  that 
delivers  groceries  causes  changes  in  nutrition"  (1983.  p. 
445).    Overstated  or  not,  he  got  everybody's  attention.  These 
authors  wished  not  to  ccipare  vehicles  (slide  +  tapes),  but 
rather  the  way  that  the  cargo  (content)  was  packaged  (the 
design  formats) .    That  moved  this  study  into  the  arena  of 
media  attribute  research  with  wMch  Clark  (7.987,  p*10)  also 
has  misgivings.    But,  the  historical  inadequacy  of  cognitive 
research  on  media  attributes  seemed,  if  anything,  to  be  one 
mere  compellj^g  reason  to  pursue  this  cognitive/af fecti^'e 
study. 
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Attending  to  the  second  of  these  imperatives  was  the  most 
troublesome  because  there  are  not  yet  any  traditions  or  stand- 
ards for  performing  research  in  the  affective  domain.  Much 
confusion  and  ambiguity  surround  the  affective  domain.  Martin 
and  Briggs  (1986)  wrote  an  oversized  book  on  the  integration 
of  the  cognitive  and  affective  domains.    Yet  they  too  were 
forced  to  be  imprecise  (or  to  use  their  term,  "unfocused") 
about  the  definition  of  the  affective  domain  and  related 
concepts: 


The  affective  domain  poses  a  unique  set  of 
problems  for  educators.    First  the  definition 
of  the  domain  and  the  concepts  that  comprise 
it  are  so  broad  and  often  unfocused  that  all 
aspects  of  behavior  not  clearly  cognitive  or 
psychomotor  are  lumped  together  in  a  category 
called  <:he  affecti  a  domain.    For  example,  all 
of  the  following  terms  can  be  found  associated 
with  affect:    self-concept,  motivation,  inter- 
ests, attitudes,  beliefs,  values,  self-esteem, 
morality,  ego  development,  feelings,  needs 
achievement,  locus  of  control,  curiosity, 
independence,  mental  health,  personal  growth, 
group  dynamics,  mental  imagery,  and  person- 
ality (p. 12). 

Rincness  (1975)  defined  the  affective  domain  and  used 
another  set  of  terms  ~  emotions,  interests,  preferences, 
tastes,  attitudes,  values,  morals,  character,  and  personality 
adjustment  ~  as  important  parts  of  the  domain.    Martin  and 
Briggs  (1986),  like  Gephart  and  Ingle  (1976),  identify  affect- 
ive behaviors  as  having  both  an  emotional  tone  and  a  cognitive 
component.    Neither  set  of  authors  has  suggested  a  sure  fire 
way  to  separate  the  two  components  or  even  to  identify  where 
one  leaves  off  and  the  other  begins.     Isolating  anything  to  do 
with  the  affective  domain  is,  to  use  the  vernacular,  like 
attempting  to  nail  jello  to  the  wall. 


The  sight  and  Hearing  Contimia 

The  Wileman  Typology  basically  established  a  sight  con- 
tinuum with  all  words  at  one  end  and  no  words  at  the  other 
that  interleaved  »  th  a  concurrent  continuum  that  progressed 
from  no  pictorial  content  to  totally  pictorial.    The  opera- 
tional terms  which  the  current  authors  have  used  previously  to 
deal  with  this  reciprocal  pair  of  variables  are  "verbal- 
visual"  (Braden  &  Beauchamp,  1986) . 

In  order  to  treat  the  range  of  various  kinds  of  visual 
images  used  in  instruction  as  a  single  variable  it  was  neces- 
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sary  to  consider  the  typology  as  a  single  continuum,  assume 
some  cognitive  message  content,  and  re-name  the  poles  of  the 
continuum  as  "verbal"  and  "non-verbal."    This  was  more  a 
nomenclature  c'^ange  than  anything  else.    Anytime  a  slide  is 
shown,  for  example,  sciaettting  appears  on  the  screen.  Accord- 
ingly, the  inverse  relationship  of  word  elements  to  pictorial 
elements  means  that  in  this  typology  both  variables  are 
present  if  either  variable  is  represented. 

For  the  sense  of  hearing  the  analog  is  also  a  pair  of 
reciprocal  variables,  but  here  too  the  variables  are  inversely 
related  and  can  be  treated  as  a  single  continuvim  with  the 
bipolar  extremes  labeled  verbal  and  non-verbal. 

Figure  l  shows  graphically  how  these  sight  and  hearing 
continua  would  apply  to  the  visual  and  sound  components  of  a 
slide+tape  program.    A  confounding  factor  for  this  type  of  in- 
vestigation is  the  lack  of  complete  understanding  about  hemis- 
pheric specialization  of  the  human  brain.    The  so-called  left 
brain  /  right  brain  dichotomy  may  have  a  high  correlation  to 
the  visual  and  audible  continua  as  shown  in  Figure  1.  .lowever, 
this  study  was  not  intended  to  be  brain  lacerality  research, 
and  the  authors  reserve  judgment  on  the  implications  of  these 
results  t-.o  the  growing  body  of  brain  function  literature. 


VERBAL 


NON-VERBAL 


READL 
SLIDES 


VISUAL  CONTINUUM 


^  PICTURE 
SLIDES 


NARRATED 


AUDIBLE  CONTINUUM 

TEXT    >  MUSIC 

Figure  l.    The  visible  and  audible  continua 


METHODS 

Four  slide  +  tape  presentations  were  constructed  by  the 
primary  researcher  (Beauchamp,  1988)  to  be  shown  to  four  dif- 
ferent groups  of  students.    A  two-continua  approach  was 
employed,    establish -ng  a  visual  continuum  and  an  audible  con- 
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"verbal"  and  "non-verbal"  as  the  bipolar  extremes 
on  both    continua.    The  design  features  of  each  of  the  foS? 
presentations  are  illustrated  in  Figure  2.    They  can  be 
described  as  single  screen,  linear  slide  +  tape  presentations 

'  "^""^^^  ^°  length  conIlI?!Sg^o^  ?he 

^eii^Ti^fi^^^^r^!'  (Treatment  A)  picture  slides  as  thi  °non- 

^hr"ierbi?"^2?™n^^%7i^"^".^°"^^""^  narrated  tex?  as 
nV  r.««2  °^         "audible"  continuum;  (Treatment 

tinJu™  !nH^^''*^%^!  ""^^  "verbal"  element  of  the  "visua?"  cSn- 
^aSS^i!^    narrated  text  a3  the  "verbal"  element  of  the 

"noS-verhf|H"!r  'yis'-al"  continuum  and  music  as  the 

f?r2;^™fn?  m^-^r^  °^         "audible"  continuum;  and 
iSe  "J?ISal"^c^iJ?n"  ^^^^^^       ""^^  "non-verbal"  element  of 
n?%ho       i       "^^"''V"'  and  music  as  the  "non-verbal"  element 
conelted  tirouaS°?J^""""'-  °"  cognitive  achievemenrwere 
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Figure  2.    The  slide  +  tape  matrix 

as  a  f"ctJororS^ -^^Z"  treatments  was  measured 

sel^es^i  e      ?Je  Si^??^^  1°"^''^         presentations  them- 
es. I.e.,  the  reaction  toward  "the  show",  and  toward  the 
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topic  of  the  presentation.  (In  all  cases  the  subject  matter 
was  about  the  relative  barrenness  of  the  oceans  —  an  esoteric 
topic  previously  unencouncered  by  all  subjects.)    A  semantic 
differential  technique  using  two  concept  ideas  and  eleven 
bipolar  adjectives  for  each  concept,  an  attitudinal  question- 
naire using  both  Likert  scele  questions  and  techniques  from 
the  Semantic  Differential,  and  two  descriptive  essay  questions 
were  employed  to  collect  data  in  the  affective  domain. 

A  quasi-naturalistic  "retelling"  procedure  was  used  to 
gain  additional  insight  into  the  cognitive  achievement  of  the 
four  treatment  groups.    The  retellings  also  produced  attitud- 
inal data  not  obtained  by  the  attitudinal  instruments,  even 
though  that  was  not  the  original  purpose  for  employing  the 
procedure. 

Statistical  data  were  compiled  and  computer  analyzed 
through  the  use  of  a  commercial  statistical  package.    The  pro- 
cedures were  traditional:    analysis  of  covariance,  one-way 
analysis  of  variance,  Dunnett's  Test  for  Critical  Differences, 
and  crosstabulations.    The  results  of  the  statistical  proce- 
dures are  reported  in  detail  elsewhere  (Beauchamp,  1988). 


Findings 

The  findings  of  this  study  showed  that  significant  dif- 
ferences existed  among  the  four  treatment  groups  in  the  degree 
ol  cognitive  achievement.    The  evidence  was  clear  that  the 
ways  in  which  viewed  material  and  heard  material  are  combined 
make  a  difference  in  learner  achievement.    Earlier  findings 
suggesting  that  students  learn  more  when  information  is  seen 
than  heard  (e.g.,  Treichler,  1967)  were  confirmed.  Also, 
earlier  findings  suggesting  that  visuals  have  utility  as  a 
trigger  for  recall  of  prior  knowledge  that  can  be  used  to  help 
in  cognition  were  confirmed  (e.g.,  Fleming    &  Levie,  1979). 

There  also  were  significant  differences  among  the  groups 
in  the  degree  of  affective  response.    These  significant  dif- 
ference extended  to  both  the  presentation  itself  and  to  the 
topic  of  the  presentation.    The  evidence  here  too  seems  clear 
that  affective  response  can  be  influenced  by  the  design  deci- 
sions which  determine  the  formula  for  combining  heard  elements 
and  viewed  elements  of  instruction. 

There  are  linkages  between  affect  end  cognition,  but  the 
nature  of  these  relationships  was  not  isolated  by  this  study. 
Some  linkages  were  demonstrated  to  be  hit  or  miss.  Among 
other  things,  affective  stimuli  were  not  shown  to  reliably 
stimulate  cognitive  recall. 
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Conclusion^ 


The  statistically  significant  findings  together  with  the 
naturalistic  data  have  been  incorporated  into  the  following 
summary  set  of  conclusions.    Although  these  results  are 
presented  in  a  generalized  form  and  are  drawn  from  data 
analysis,  there  is  not  enough  evidence  in  this  single  study  to 
claim  generalizability  to  other  environments. 


1.  In  a  slide  +  tape  (sight  +  sound)  presentation,  when 

verbal  language  is  used  to  appeal  to  only  one  sense 
via  either  printed  or  spoken  words,  cognitive 
achievement  is  not  significantly  diminished. 

2.  Pictures  used  in  a  slide  +  tape  (sight  +  sound) 

presentation  prompt  viewer  recall  from  memory  or 
experience  of  information  not  in  the  presentation. 

3.  Cognitive  stimuli  prompt  immediate  cognitive  recall. 

4.  Visuals,  especially  photographs,  prompt  iiwnediate 

positive  affective  responses  to  a  presentation. 

5.  Music  from  a  slide  +  tape  (sight  +  sound)  presenta- 

tion, more  so  than  visuals,  prompt  long  range,  or 
delayer^,  positive  affective  responses. 

6.  Students  are  aware  of  "when"  and  "if"  they  are  learn- 

ing. Changing  the  delivery- of -instruction  mode  does 
not  change  this  apparently  innate  sense  of  learning. 

7.  A  desired  change  in  attitude  is  prompted  through  the 

introduction  of  new  concepts  and  ideas,  not  through 
the  presentation  itself. 
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Factors  Influencing  MenUl  Effort: 
A  Thooreticol  OvorWev  and  Review  of  Literature 

Several  rosoarchers  (Krendi  L  Watkins,        Salomon.  1984.  Salomon  U 
Leigh        nave  suggested  mat  the  learner's  preconceptions  or  a  medium  are  an 
iaflucntiallactor  ir  achievement.  For  example.  Salomon  found  that  learners 
perceive  tcievisioh  as  easier  than  print  and  they  report  investing  more  mental 
effort  i     learn  more  from  a  text-based  L-r,f»n   Winn  (1985).  Hannafin  <  19S5^  and 
Clark  (i  >S3)  have  recently  called  for  an  investigaiun  of  the  ways  in  which 
different  forms  of  media  are  perceived  and  how  these  perceptions  influence  mental 
processing. 

The  purpose  of  this  paper  is  to  summarize  the  theoretical  basis  of  the 
relationship  between  prcwonceptionsand  the  construct  of  "mental  effort  .  to 
identify  factors  that  researchers  have  shown  to  influence  mental  effort  and  to 
suggest  an  agenda  for  future  research  ir^  this  area.  General  areas  relevant  to  an 
examination  of  mental  effort  include  1 )  cognitive  procer    ig  theory.  2)  motivation 
theory,  and  3)  specific  research  on  mental  effort  Particular  emphasis  will  be 
placed  on  studies  that  investigate  tne  processing  of  video-based  instruction 

Theoretical  Ba^sisof  the  Relationship  between  Preconceptions  and  Mental  Effort 

Salomon  ( 1983a)  defines  the  construct  of  "mental  effort"  as  the  'number  of 
non-automatic  elaborations  applied  to  a  unit  of  material"  (p.42)  and  uses  the 
construct  to  refer  to  the  motivational  and  cognitive  aspects  of  information 
processing.  The  conscious,  effortful  processing  that  results  from  increased  mental 
effort  is  assumed  to  make  more  contact  with  tne  learner's  mental  schemata,  leaving 
more  memory  traces  and  facilitating  the  retention  of  the  material.  An  examination 
of  cognitive  and  motivational  theory  may  suggest  ways  that  learners' 
preconceptions  are  related  to  the  mental  effort  expended  when  processing  a 
mediated  lesson. 


Cognitive  Theories 

Several  theories  have  been  offered  to  explain  the  cognitive  processing  of 
video-based  materials  One  set  of  theories  present  the  viewer  as  passively  involved 
in  the  viewing  experience.  Proponents  believe  that  the  degree  to  which  a  person 
attends  to  the  video  effects  the  level  of  comprehension  (Singer,  1980)  In  contrast, 
proponents  of  various  active  processing  theories  contend  that  attention  results 
from  the  need  to  fill  slots  in  schemata  with  expected  information  (Anderson  & 
Lorch.  19S3). 

Reactive  theory  In  the  reactive  theory  of  television  viewing,  television  is 
seen  as  eliciting  and  i>w5taining  attention  through  salient  formal  features  such  as 
quick  movement,  quick  cuts,  and  sound  (Anderson  U  Lorch.  1983.  Singer.  1980) 
Singer  ( 19S0)  further  developed  this  theory  and  proposed  that,  due  to  constant 
visual  and  auditory  changes,  television  creates  a  continuous  series  of  orienting 
responses  According  to  Singer,  a  heightened  awareness,  or  orienting  response, 
occurs  whenever  a  person  is  presented  with  any  new  or  unexpected  stimulation, 
once  the  new  information  can  be  assimilated  into  a  preestablished  schema,  a  person 
quickly  habituates  to  the  situation  in  order  to  be  ready  to  respond  to  other  new 
stimuli  in  the  environment.  Singer  attributed  television's  appeal  to  the  viewers 
inability  to  habituate  to  the  televised  stimuli  and  the  resulting  pleasure  that  is 
derived  from  small  doses  of  novelty  With  the  constant  appearance  and 
reappearance  of  characters  on  television,  the  viewer  must  continually  attempt  to 
orient  to  the  information  presented  and  therefore  continues  to  attend  to  the 
program  even  if  no  longer  interested 
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The  viewer  is  influenced  by  the  video  program  and.  as  such,  the  vie^ver  s 
-  .>  ?   mtentions,  and  strategies  are  perceived  as  exerting  a  minimum  of  mfluence 
<  liHipk  tension  is  seen  as  following  from  attention,  and  in  fact,  the  information 
rotaoe.^  is  considered  to  be  ata  lov  level  since  'pressures  of  attention  to  novel 
stimulation  can  actually  interfere  with  our  ability  to  store"  information  (p  3S)  He 
concluded  that  television  viewing  as  a  pass;vo  cognitive  acr  .vity  "will  yield 
considerable  recognition  memory  without  efficieni  retrieval"  (p  42) 

Active  processing  theories  TJus  view  is  in  marked  contrast  to  the  active 
processing  theories  (Anderson  &  Lorch,  1985).  Active  processing  theorists  contend 
that  viewers  are  instead  extremely  well  "habituated"  to  television  viewing,  and  thai 
habituation,  or  well  established  scripts,  may  inhibit  the  active  processing  of  video- 
based  instruction.  Theorists  assume  that  viewers  develop  expectations  about  the 
temporal  and  conceptual  flow  of  television  programs  through  experience  These 
expectations  are  part  of  a  vie-ying  schema  that  guides  the  viewer  in 
comprehending  the  video  program 

Active  processing  theorists  propose  that  attention  is  maintained  by  the 
viewer's  ability  to  answer  questions  posed  by  the  schema.  If  all  the  slots"  dictated 
by  the  schema  are  filled,  attention  is  terminated,  or  if  the  user  is  unable  to  call 
upon  an  appropriate  narrative  schema,  attention  is  also  terminated.  (Anderson  & 
Lorch,  1983).  Whereas  with  the  reactive  theory,  comprehension  follows  from 
attention,  from  an  active  processing  viewpoint,  the  primary  casual  relationship  is 
from  comprehension  to  attention.  The  viewers'  need  to  fill  slots  in  their  schemata 
guides  iheir  attention. 

This  notion  of  schema  is  similar  to  the  concept  of  "scripts  "  promoted  by 
Shank  and  Ableson  ( 1977).  Like  schemata,  scripts  are  made  up  of  slots  and 
requirements  about  what  can  fill  these  slots.  But  whereas  schemata  are  broad 
organizational  structures  that  include  both  concrete  and  abstract  knowledge,  a 
script  ie  a  type  of  cchema  that  contains  an  individual's  knowledge  of  an  event 
sequence  (Ableson,  19S1).  When  an  individual  is  presented  with  a  situation  with 
which  he  or  she  has  pn  vious  experience,  the  individual  then  enacts  a  script  that 
was  written  when  the  experience  was  new 

As  an  event-based  cognitive  structure,  scripts  pby  a  double  role  in 
television  viewing  (Ableson,  1981)  One  type  of  script  is  used  for  the 
understanding  of  the  events  seen  on  television  and  another  type  of  script  is  used  in 
the  behavior  of  television  viewing  A  script-based  understanding  of  the  events 
involves  the  cognitive  retrieval  of  previous  situations  to  which  the  present 
situation  is  similar"  (Ableson,  1981,  p.  719)  and  typically  utilizes  a  type  of  script  that 
Shank  and  Ableson  (1977)  refer  to  as  a  situational  script.  For  example,  when  one 
scene  in  a  television  program  presents  the  hero  in  his  living  room  and  the  next 
scene  shows  him  at  a  crime  scene,  most  viewer?:  '^o  not  i.^sume  that  the  crime  scene 
and  the  living  room  are  in  the  same  location.  The  viewers  situational  scripts 
provide  the  connecting  events  which  may  lead  them  to  conclude  that  the  hero  left 
his  living  room  and  drove  to  tl;e  scene  of  the  crime  Such  situational  scripts  are 
critical  to  the  comprehension  of  events  that  are  viewed  on  television 

But  as  a  behavior,  television  watching  involves  an  mstrumenul  script 
rathe  ^  than  a  situational  script  Instrumental  scripts  are  similar  to  situational 
scripts  but  instrumental  scripts  involve  only  one  player,  whereas  situational 
scripts  involve  multiple  participants  (Schank  and  Ableson, 1977)  Although  there 
may  be  several  people  present  when  an  individual  is  watching  television,  the 
behavior  of  watching  television  is  a  personal  act  that  requires  only  one 
particip?nt  Instrumental  scripts  also  differ  from  situational  scripts  in  that  the 
sequence  of  actions  in  an  instrumenul  script  is  so  fixed  and  uninteresting  that  the 
?t»P!<  ia  th©  pfoce.ss  tray  be  fnrjjotten  untirely  and  all  that  is  usually  remembered  is 
the  goal  For  example,  if  you  v/ere  to  ask  learners  what  they  do  u'hen  they  watch 
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TV.  you  would  probably  be  told  that  tht  v  !U!?t  'rum  it  on  and  vatch Because  we 
cao  assume  that  most  learners  have       :xi»  n  wr  orior  experience  with  watching 
television,  we  can  assume  that  learner  ,)  jvc  a  ill  Jeveloped  instrumental  scripts 
for  such  activities,  however,  the  sp .  .a.*  iuja^oivH  script  eni^aged  by  the  learner 
would  depend  on  the  learner's  experience  vith  the  events  depiciod  m  the  television 
program. 

Langer  and  her  associates  danger.  Blank.  &  Chanowiu.  197S.  Langer  & 
Imber.  1979)  use  the  concept  of  mindlessness.  rather  than  scripts,  to  explain 
habitual  information  processing  in  the  face  of  familiar  stimuli.  In  order  to  be 
processed  mindlessly,  a  task  or  message  must  be  overlearned  and  congruent  with  an 
individual  s  past  experience.  When  the  message  appears  to  be  familiar  and  fits  in 
well  with  the  individual  s  anticipatory  schema,  a  routine  for  the  activity  substitutes 
for  active  processing  and  information  perceived  to  be  known  is  ignored. 

The  lack  of  conscious  control  over  the  performance  of  a  task  that  is 
inherent  in  mindless  behavior  leaves  the  individual  vulnerable  to  problems  or 
errors  in  behavior.  Based  on  Langer's  theory,  it  seems  likely  that  learners  who  are 
accustomed  to  television  viewing  as  a  recreational  task  would  have  difficulty 
modifying  their  performance  in  response  to  an  instructional  videotape 

Mindlessness.  scripts,  and  schemata  are  all  theoretical  constructs  that  place 
a  great  deal  of  emphasis  on  the  role  of  prior  experience.  The  more  familiar 
individuals  are  with  a  task,  the  stronger  their  preconceptions  of  it.  The  stronger 
thes^  preconceptions,  or  the  more  easily  they  are  availahle  to  processing,  the 
greater  the  probability  that  these  preconceptions  will  ^uide  the  individual's 
response  to  the  presented  material.  The  extent  to  which  preconceptions  include 
beliefs  or  expectations  about  the  amount  of  mental  effort  required  by  the  task  may 
affect  the  amount  and  nature  of  non-automatic  elaborations  of  the  material 
(Salomon.  i9S3b) 

Motivational  Theories 

Salomon  s  ( 1981 )  concept  of  "amount  of  invested  mental  effort"  ( AIME  )  "is 
cognitive  in  the  sense  that  it  pertains  to  mental  elabo^'ations  of  information 
material  But  as  these  elaborations  are  controlled,  rather  than  automatic,  their 
employment  implies  an  measure  ol  choice  (Salomon.  19S3,p  44)  Because  the 
individual  must  choose  to  engage  in  active  processing,  the  construct  of  mental 
effort  has  motivational,  as  well  as  cognitive,  components. 

A  cognitive  view  of  motivation  emphasizes  the  internal  events  that  lead  ?n 
individual  to  engage  in  an  activity  These  internal  events  may  include  curiosity, 
uncertainty,  causal  attributions,  and  expectations  for  success  (E  Cagne.  19S3) 
Berlyne  s  ( 1%0)  curiosity  tht?ory  and  Weiner  s  (1979)  attribution  theory  seem 
especially  applicable  to  the  processing  of  a  mediated  lesson 

Curiositv  theory  Although  not  directly  concerned  with  the  construct  of 
mental  effort,  another  cognitive  theory  of  motivation  may  help  to  explain  the 
increase  in  achievement,  and  presumably  mental  effort,  that  is  so  often  found 
when  content  is  presented  in  a  novel  manner.  According  to  Berlyne  ( when 
the  learner  experiences  something  that  is  novel,  surprising,  or  complex,  a 
heightened  sense  of  arousal  and  uncertainty  is  produced.  This  aroused  state  leads  to 
exploratory  behavior  m  order  to  reduce  the  unpleasant  feeling  of  uncertainty  As 
the  learner  gathers  information,  the  uncertainty  is  reduced  and  the  resulting 
reduction  in  arousal  is  reinforcing  to  the  learner.  Berlyne  s  theory  may  account 
for  the  increases  in  attention  in  response  to  televised  excitement  documented  by 
the  reactive  theorist  of  television  processing  (Singer.  19S0). 

In  addition  to  the  perceptual  curiosity  that  results  from  novel,  surprising  or 

complex  stimuli  addressed  above.  P^rlyne  (1960)  also  recognuesepistemic  curiosity 

caused  by  thoughts,  beliefs  or  attitudes  (hat  may  bo  discrepant  with  prior  beliefs. 
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Episiemic  curiosity  may  be  especially  valuab' as  questiming  strategies  ma^'^ 
utilized  to  create  the  co«aitive  conflict  that  resulu  in  increased  exploratory 
behavior  directed  toward  the  reduction  of  uncertainty  !q  gimtral.  Berly;  t  5> 
theory  suggesU  that  novel  situations  or  cognitive  conflict  mav  result  m  a 
temporary  incwase  in  mental  effurt  directed  at  reducing  the  uncertainty  iau  is 
experienced  vhen  learners  confront  a  stimulus  that  is  inconsistent  with  their  prior 
experience. 

AttfibutiOfl  theory  There  is  some  research  evidence  ^hat  learners 
attribute  their  success  and  failure  in  learning  from  print  to  different  ca«^ses  than 
they  -tfribuie  their  successor  failure  in  learning  from  television  (  Salc-mon,  1984) 
According  to  Weiner  ( 1979),  the  reasons  that  people  give  for  a  success  or  failure 
contributes  to  the  mental  effort  that  will  be  exerted  in  similar  situations  in  the 
future.  Weiner  proposed  that  individuals  attribute  their  success  or  failure  to  one  of 
the  four  broad  classes  of  luck,  effort,  difficulty  of  the  task,  or  ability.  The 
aiJribuliott  provided  in  a  situation  of  success  or  failure  influences  the  extent  to 
which  the  individual  will  persist  at  the  task.  Weiner  contends  that  casual 
attributions  for  failure  to  unstable  causes  such  as  effort  or  luck  increase  task 
persistence  more  than  attributions  to  stable  causes  such  as  ability  or  izsk  difficulty 
Of  the  two  attribution?  that  increase  task  pcrsisteace,  attributing  a  task  outcome  to 
effort  resulL  in  the  greatest  task  persistence  since  effort  is  under  the  control  of  the 
individual. 

The  perceived  task  difficulty  is  also  thought  to  influence  the  amount  of 
effort  expended  (Weiner,  1979).  Although  task  difficulty  is  a  stable  cause  beyond 
the  control  of  the  individual,  it  is  instrumental  ii3i  providing  cues  as  to  the 
efficiency  of  effort.  Weiner  contended  that  individuals  seek  to  engage  in  task.s  in 
order  to  gain  information  about  their  ability.  Individuals  seem  to  work  be«<  at  !asks 
of  intermediate  difficulty  because  engaging  in  difficult  tasks  provides  little 
information  abnut  their  ability  or  effort  expenditures  and  may  be  perceived  &s  a 
wasie  of  energy  while  easy  tasks  are  perceived  as  unnecessary  for  surcf^ss  When 
faced  with  tasks  of  intermediate  difficulty,  individuals  that  attribute  success  or 
failure  to  effort  exert  a  maximum  of  effort  since  these  individuals  believe  that  the 
best  performance  strategy  for  high  achievement  in  such  situations  is  to  try  harder 

Salomon  (1984)  analyzed  student  attributions  of  success  and  failure  in 
learning  from  print  and  television  and  found  that  students  attributed  success  with 
television  to  external  causes  such  as  ease  of  material,  and  attributed  success  with 
print  to  the  reader,  (k^nversely,  failure  with  television  was  attributed  to  internal 
causes  such  as  lack  of  effort  and  failure  with  print  was  attributed  to  the  difficulty  of 
the  material.  It  is  interesting  to  note  that  learners  attributed  success  and  failure 
with  print  to  stable  causes,  but  they  attributed  failure  with  television  to  the 
unstable  attrloution  of  effort.  As  previously  stated.  Weiner  ( 19S?)  has  suggested 
that  attributions  df  effort  can  result  in  the  greatest  task  persistence  since  it  is  ver/ 
much  under  the  control  of  the  learner.  Th   study  suggests  that  if  learners  can 
come  to  view  television  as  worthy  of  the  exertion  of  additional  mental  effori.  or 
moderately  difficult  according  to  Weiner,  then  thev  will  exert  a  maximum  jf  effort 

Summary  of  cogn^ti^^  and  motivational  theory 

A  review  ot  cognitive  and  motivational  theory  indiciles  that  conscious  and 
unconscious  preconceptions  such  as  scuots,  schemata,  attributions,  and  curiosity 
each  seem  to  influence  mental  effort.  According  to  cognitive  and  motr/aticnal 
theory,  learner  preconceptions  are  influenced  by  several  factors 

Eas4SXIlSCi£fl££L  Past  experiences  play  a  crucial  role  in  the  preconceptions 
that  learners  bring  to  a  learning  environment.  Learner  scripts  and  schemata  are 
abstracted  from  prior  experience  aud  extcacive  prior  experience  may  result  in 
overlearning  and  mindless  behavior 
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Perceived  task.  The  particular  script  or  schema  engaged  in  response  to  a 
learning  task  is  influenced  by  the  perceived  purpose  of  the  task.  Attribution 
theory  also  indicates  that  the  way  that  the  task  is  perceived  influences  the  amount 
of  mental  effort  engaged  in  processing  a  lesson. 

Characteristics  of  the  media  The  characteristics  of  the  media  cue  the 
learner  as  to  the  appropriate  instrumer  al  script  to  engage  and  contribute  to  the 
preconceptions  that  learners  bring  to  an  in:>tj  actional  setting.  In  addition, 
curiosity  theory  suggests  that  novelty  and  structural  characteristics  such  as 
embedded  questions  may  create  cognitive  coQilLct  and  result  in  a  temporary 
increase  in  mental  effort  in  order  to  reduce  the  internal  conflict. 

In  summary,  the  learners'  past  experience,  the  perceived  task,  and  the 
characteristics  of  the  media  may  each  contribute  to  the  preconceptions;  that 
learners'  bring  to  an  instructional  setting,  ^hich  may  in  turn,  influence  the 
invested  mental  effort.  Research  that  has  examined  some  of  these  factors  vill  be 
reviewed  next. 

Research  on  Preconceptions  and  Mental  Effort 

Salomon  and  Leigh  s  (19S4)  finJing  that  high  ability  students  perceived 
television  to  require  less  effort  than  low-ability  sf;dents  and  performed  poorer 
than  lov  -ability  students  lends  credence  to  the  idea  that  preconceptions  of  the 
effort  required  to  process  a  lesson  influence  achievement.  In  order  to  more  closely 
examine  the  influence  of  preconceptions  on  mental  effort,  this  section  will  I) 
present  the  results  of  studies  that  surveyed  learners'  preconceptions  of  several 
forms  of  media.  2)  examine  the  type  of  learning  that  is  influenced  by  increased 
mental  effort,  then  3)  examine  studies  that  have  manipulated  the  perceived  task  and 
the  characteristics  of  the  media  to  determine  th^  effects  on  mental  effort. 

Learner  Preconceptions 

Since  preconceptionsof  a  medium  have  been  shown  to  influence  the  mental 
effort  investing  the  processing  of  a  lesson,  the  way  in  which  different  media  are 
perceived  is  of  intere^^i  to  an  examination  of  the  influence  of  preconceptions  on 
mental  effor  t.  As  reported  earlier.  Salomon  found  that  learners'  perceive  television 
as  easier  than  print  ( I9&3b.l984)  and  report  expending  less  effort  in  learning  from 
televised  lessons  than  from  print  based  lessons  (HS3b;  Salomon  &  Leigh.  1984). 
These  findings  may  result  from  the  fact  that  most  experience  u  \th  reading  has  been 
for  educational  rea<^ns  and  most  experience  with  television  has  been  for 
entertainment  and  that  learners'  instrumental  scripts  would  reflect  these  prior 
experiences. 

Krendl  (1986)  further  examined  students'  preconceptions  of  print  ^nd 
television  and  expanded  her  examination  to  include  computers  and  writing  Krendl 
found  that  students  preferred  computers  to  television,  television  to  reading,  and 
reading  to  writing.  They  felt  that  television  was  the  least  difficult,  followed  by.  in 
order  of  preference,  reading,  writing  and  computers  They  felt  that  they  would 
learn  more  from  reading,  followed  closely  by  computers.  Writing  ^'^as  placed 
further  down  the  scale,  followed  by  television 

Krendl  notes  that,  in  general,  the  more  an  activity  is  preferred,  the  less 
difficult  it  is  perceived  to  he.  and  the  less  likely  one  is  to  think  one  will  learn  from 
it.  Although  her  general  conclusions  were  consistent  with  Salomon's  work, 
students'  preconceptions  of  writing  and  computers  often  contrasted  with  this 
general  conclusion.  Students  rated  "'riting  as  one  of  the  more  difficult  activities, 
yet  they  rated  it  as  low  on  the  learning  scale.  Learners'  preconceptions  of 
computers  also  contrast  with  Salomon  s  finding's  that  students  tended  to  prefer 
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media  that  were  easier.  b;'t  vere  consistent  with  his  observaUoo  that  students  felt 
they  vould  iearo  n  r  r  v    .«      resentation  that  they  believed  to  be  difficult 

It  appr-vs  M.a!  ?'rHii.  4  .w.d  computers  differ  from  reading  and  television  in 
important  vay>  ft  .-lUfig  t^fi«i ,  1  rom  television  and  reading  in  that  writing 
involves  the  generaion,  rather  ihdn  the  ,;aco<iing,  of  concepts  and  ideas  Like 
writing,  computer  use  may  also  involve  thf  active  generation  of  concepts  and  ideas 
rather  than  the  passive  recepUon  of  iniormation  that  is  typical  of  reading  and 
watching  television.  Even  when  computer  use  invol  /es  the  encoding  of  ideas  as  in 
co.-nputer-assisted  instruction,  it  may  still  be  difficult  for  learners  to  rate  computer 
use  along  the  same  continuum  as  reading  a  id  television  watching  because 
computer-assisted  instruction  is  a  relatively  new  instructional  strategy  and 
students  may  have  less  predictable  scripts  for  computer  use. 

Mental  Effort  and  Luarning 

Some  researchers  (KrendlicWalkins,  1983;  Salomon  1983b;  Salomon,  1984 
Salomon  &  Uigh,  1984)  seem  *o  suggest  that  increased  mental  effort  does  not  affect 
factual  recall,  but  insttad  results  in  greater  inferences.  These  findings  indicate 
that  attenUon  may  be  f  afficient  for  recall  but  not  for  higher  level  cognitive 
processing,  which  is  consistent  with  reactive  theoriei  of  television  processing 

In  addition  ut  the  evidence  for  an  incieased  number  of  elaboraUons  as  a 
result  of  the  latreascd  mental  effort  exerted  in  text-based  instruction,  there  is  some 
evidence  tha  the  elaboi  ations  art;  of  a  different  quaUty  Whereas  children  iiposed 
to  a  video  story  base  iheir  inferences  on  visual  information,  students  that  had  heard 
the  story  read  aloud  showed  more  evidence  of  inferences  based  on  general 
knowledge  and  personal  experiences  (Meringoff,  1980  ). 

According  to  schema  theory,  learners  create  narrative  schemata  from  past 
experiences,  Salomon  ( imh)  presented  learners  with  a  jumbled  version  of  a 
vid«oUp«  and  found  that  although  the  learners  that  received  a  iumbled  version  of 
the  upe  reported  more  mental  effort  than  learners  that  received  a  normal  version 
01  the  program,  the  learners  that  received  the  jumbled  version  had  Jower 
achievement  scores.  Although  Salomon  1 1983b)  suggests  that  simply  expending 
more  effort  does  not  guarantee  increased  inferences  when  'earners  are  unable  to 
fit  the  information  into  a  preexisting  schemata,  when  Krendl  and  Watkins  (19«j3) 
conducted  a  similar  study  but  kept  the  original  narrative  intact  and  added 
irrelevant  segments,  the  learners  aucmpted  to  fit  the  incongruent  information  into 
the  story  line.  In  the  Krendl  and  Watkins  study  ( 1983).  the  availability  of  a  main 
intact  narrauve  apparently  provided  the  structure  necessary  to  tap  into  the 
vie^  3r  s  narrative  schemau  In  Salomon  s  study,  self  reports  of  increased  mental 
error  I  in  .icatcd  that  the  Earners  did  attempt  to  elaborate  on  the  material  but 
consistent  with  schema  th«ory,  their  lower  performance  suggests  that  they  may 
have  abandoned  the  effori  due  to  an  inability  to  fit  information  into  an  existing 


The  Influence  of  Perr^ivoH  J^yk  on  Mental  F.ffnrt 

u  tKrendl  &  Watkins,  1983.  ICsobiech,  1976;  Salomon  &  Lem 

1984)  have  attempted  to  manipulate  students  perceptions  of  the  task  purpose  in 
order  to  increase  the  amount  of  invested  mental  effort.  The  results  of  these  studies 
show  that  students  that  are  instructed  to  learn  from  a  lesson  exhibit  more  mental 

c^^**°"°?  ^         ^^^^      "'''•''^  8'**^'"  achievement  (Krendl  &  Watkins. 
1983;  Salomon  &  Leigh,  1984)  than  students  that  are  instructed  to  attend  to  a  lesson 
for  fUn.  In  addition,  it  appears  that  the  perceived  purpose  of  the  task  also 
iiifluences  the  modality  (audio  or  video)  that  receives  the  primary  attention  when 
viewing  a  video  tapr  (Ksohiech,  1976),  For  example,  when  instructed  to  pass  an 
exam,  subjects  frequently  sought  information  from  the  auditory  chj  inel  Since 
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itaraers  arc  very  familiar  vith  receiving  the  content  on         tiiey  are  to  be 
tested  through  auditory  channels,  as  in  a  classroom  lectui  t  thoir  ^rreased 
attention  to  the  auditory  channel  may  reflect  such  ^rcrrpis 

The  Influence  of  Characteristics  of  the  Media  on  Men^l  Effort 

The  characteristics  of  the  media  have  been  suggested    an  influenual 
factor  in  the  amount  of  mental  effort  invested  in  a  learning  task  and  one  of  tht 
primary  differences  between  text  and  televised  instruction  lies  in  the  ability  oi  the 
learner  to  control  the  pace,  therefore,  these  differences  may  be  offered  an 
alternative  hypothesis  to  explain  the  increase  in  both  number  and  kind  of 
elaborations  evidenced  by  students  that  received  a  print  lesson.  This  alternative 
hypothesis  was  tested  by  Krendl  and  Watkins  ( 1983).  Hovever.  Krendl  and  Watkins 
found  that  students  that  were  alloved  to  stop  a  videotape  at  any  time  they  wished  tu 
ask  a  question,  make  a  comment,  and  so  forth,  did  not  exhibit  significantly  higher 
scores  on  measures  of  recall  and  higher  level  processing  than  students  that  vere 
not  allowed  to  control  the  pace  of  the  videotape,  suggesting  that  student  control  of 
the  pace  of  a  video  lesson  does  not  significantly  increase  the  amount  of  mental 
effort  invested  in  processing  a  video-based  lesson. 

Summary 

Preconceptions  based  on  past  experiences,  perceived  task  utility,  and  media 
characteristics  each  seem  to  influence  mental  effort.  Past  experiences  influence 
the  scripts  and  schemata  that  individuals  bring  to  the  learning  environment 
While  of  crucial  importance,  past  experiences  can  not  be  easily  altered  by  the 
researcher,  teacher  or  instructional  designer.  However,  learner  expectations  of 
the  future  usefulness  of  the  information  can  be  successfully  manipulated. 
Researchers  (Krendl  &  Watkins.  1983.  Salomon  &  Leigh,  1984)  indicate  that  students 
that  are  instructed  to  learn  from  a  lesson  exhibit  significantly  greater  mental 
effort  and  achievement  than  individuals  instructed  to  atte:  1  to  a  lesson  for  fun.  In 
addition  to  manipulating  the  learner's  perception  of  the  goal  of  the  task,  the 
characteriftics  of  the  media  may  also  be  manipulated  to  increase  the  amount  of 
invested  mei^tal  effort.  Although  learner  control  of  the  pace  of  a  video  lesson  did 
not  seem  to  significantly  increase  achievement  (Krendl  &  Watkins.  1983).  there  are 
other  structural  characteristics  of  video-based  instruction  that  may  be  varied  in 
order  to  increase  mental  effort. 

Suggestions  fot  Future  Research 

Several  researchers  (Britton.  Glynn.  Meyer,  &  Penland.1982.  Burton.  Niles, 
and  Lalik.1986.  Reynolds  and  Anderson.  1982;  and  others)  have  manipulated  the 
structural  characteristics  of  text  materials  and  used  a  secondary  task  techniques  to 
measure  the  amount  of  cognitive  capacity  used  during  processing  the  printed 
lessons.  In  these  studies,  subjects  were  told  that  comprehending  the  text  was  their 
primary  task,  but  were  also  told  tu  deoress  a  key  as  quickly  as  possible  following  a 
given  sound.  This  technique  assumes  that  individuals  have  a  fixed  amount  of 
cognitive  capacity.  When  subjects  are  concentrating  on  the  priaury  task  of 
attending  to  the  lesson,  it  is  assumed  that  subjects  will  take  longer  to  respond  to  the 
sound  than  iu  a  baseline  condition  because  there  would  be  little  cognitive  capacity 
available  to  process  the  secondary  task  aftd.  therefore,  reaction  time  would  be 
delayed  until  additional  capacity  became  available  This  technique  also  assumes 
that  there  is  a  correlation  between  response  time  tu  a  secondary  task  and  the 
amount  of  mental  effort,  or  cognitive  capacity,  in  use  at  the  time  of  the  response 

It  is  interesting  to  note  that  in  these  sujdies.  cognitive  capacity  usage  *  ha^  / 
been  operationally  defined  in  a  manner  that  is  similar  to  Salomon  s  construct  of 
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mental  effort.  Although  this  to(  hniqt;*  ht^s  not  been  used  in  studies  of  mental 
effort.  Salomon  (1984)  hassug.n^       »       vay  of  measuring  'amount  of  invested 
mental  effort '  ( AIME)  is  by  lii  *  dcia     « ^  ji  esponding  to  some  secondary  task 
while  attending  to  the  primai ;  task  -  i  ^r  viewing  the  stimulus  material 

Since  cognitive  capacity  usage  and  ALME  are  operationally  define  in  a  similar 
manner  in  these  studies,  ve  can  assume  that  the  techniques  that  are  shown  tu 
increase  the  amount  of  cognitive  capacity  used  in  processing  would  also  increase 
AIME  and  achievement.  An  examination  of  studies  that  incorporate  a  secondary 
task  technique  to  measure  the  amount  of  mental  effort  invested  in  a  learning  task 
may  suggest  ways  that  the  structural  characteristics  of  video-based  instruction  can 
be  modified  to  increase  the  mental  effort  that  learners  invest  in  processing  the 
lesson. 

Embedded  question 

Several  studies  (Britton,  Piha,  Davis  &  Wehausen,  1978;  Reynolds  and 
Anderson, 1982;  and  others)  examined  the  role  of  embedded  post-questions  in  text 
using  a  secondary  task  technique  to  measure  the  amount  of  cognitive  capacity  used 
during  processing  and  may  be  of  interest. 

Reynolds  and  Anderson  (1982)  found  that  reaction  times  to  a  secondary  task 
were  significantly  delayed  when  subjects  were  reading  text  segments  containing 
information  that  was  relevant  to  the  questions  as  compared  to  segments  containing 
question-irrelevant  information.  Britton  and  his  colleagues  (Britton.  Piha.  Davis  & 
Wenausen.  1978)  conducted  a  similar  study  using  text-relevant  questions,  irrelevant 
question  or  no  questions.  They  found  than  the  cognitive  capacity  usage  increased 
when  questions  that  were  relevant  to  the  text  content  began  but  similar  increases 
were  not  observed  when  irrelevant  questions  began  or  when  no  questions  were 
provided.  This  study  suggests  that  the  increased  cognitive  capacity  usage  that 
resulta  from  embedded  questions  is  due  to  some  sort  of  content  specific  processing 
rather  than  an  effect  of  the  presence  of  embedded  questions  in  text.  Because  the 
increase  in  reaction  time  to  o  secondary  imsk  was  largoat  on  pagee  ittM^diai^iy 

following  the  questions.  Britton  and  his  colleagues  concluded  that  the  increased 
cognitive  capacity  usage  following  the  embedded  questions  indicates  that  the 
learners  are  engaging  in  elaborations;  of  the  content  materials. 

Although  these  studies  did  not  examine  cognitive  capacity  us^ge  in  response 
to  embedded  questions  in  video*based  materials.  Anderson  and  Biddle  (1979) 
thoroui;bty  reviewed  the  literature  on  embedded  questions  in  studies  that  used  film, 
lecture  videotape  or  text  ^^nd  found  that  the  medium  of  presentation  did  not  seem  to 
matter  much,  questtoni     statagies  affect  the  processing  of  text  and  video-based 
instruction  similarly. 

Several  researchers  have  included  embedded  questions  in  video-based 
materials  and  measured  the  alTects    achievement  with  minced  results.  Some 
rcset^r«.hers  (Heestand.  1980:  Lipsky.  1983)  have  found  that  the  inclusion  of 
e.mbedded  questions  yields  grcL'^r  achievement  scores  than  the  presenution  ol  a 
video  tape  without  embedded  questions,  while  other  researchers  (Schaffer  & 
Hannafin.  1983:  Teather  &  Marchant.  1974)  suggest  that  the  embedded  questions 
must  be  followed  by  feedback  ifi  order  to  effectively  increase  achievement  Dalton 
( 1985)  suggests  that  requiring  l^^arners  to  actively  respond  to  the  embedded 
questions  is  even  more  effective  than  simply  providing  the  learners  with  embedd' 
questions  and  feedback.  If  learners  do  invest  greater  cognitive  capacity  in 
processing  a  lesson  that  includes  embedded  questions,  increased  in  mental  effort 
may  account  for  the  increases  in  achievement  documented  in  these  studies 

In  future  research,  the  incorporation  of  asecondary  task  technique  asa 
(f<>&f»ndvni  m^a^ure  would  allow  researchers  to  determine  if  techniques,  such  as 
embedded  questions,  that  have  been  shown  to  increa:>e  the  cognitive  capacity  used 
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in  processins  text-based  materials  would  also  increase  the  mental  effort '  iv<^ff<^d  in 
processing  video-based  lessons.  Future  research  in  video-based  instruc  ri«  o  ^^h'  ^lo 
also  explore  the  manipulation  of  other  structural  characteristics  to  li  Jier;  i >  ,<e  vv  ay> 
that  the  learners'  preconceptions  of  television  as  a  passive  medium  c^f\ 
overcome  to  result  in  increased  mental  effort  and  achievement 

Other  fat  tors 

In  addition  to  the  use  of  embedded  questions,  several  other  methods  of 
increasing  the  cognitive  capacity  ir^d  in  processing  a  text-based  lessen  have  been 
investigated.  A  fev  of  the  techniques  that  vould  be  appropriate  for  use  with  video- 
based  instruction  are  briefly  noted  below. 

INFORMING  THE  LEARNER  OF  THE  OBJECTIVES:  Students  that  were  provided 
with  specific  learning  objectives  used  more  cognitive  capacity  when  reading 
obfective  relative  information  than  learners  that  were  provided  with  general 
instructions  to  pay  special  attention  to  a  particular  section  or  learners  that  were 
provided  with  no  learning  objectives  (Britton,  Glynn.  Muth,  &  Penland.  19%^) 

RELAFING  TO  PRIOR  KNOWLEDGE:  Several  studies  (Britton,  Holdredge.  Curry 
U  Westbrook,  1979:  Britton  &Tesser.  19S2;  and  others)  suggest  that  learners  invest 
more  mentr'  effort  in  processing  lessons  in  which  they  have  some  prior  knowledi;e 
of  the  topic.  For  example,  when  learners  were  presented  with  a  passage  that  was 
meaningless  without  a  title,  the  learners  that  read  the  passage  with  the  title 
invested  more  mental  effort  in  processing  t'  e  passage  than  the  learners  that 
received  the  same  passage  without  the  title  (Britton.  Holdredge.  Curry  and 
Westbrook.  1979).  It  appears  that  the  title  may  h;!ve  made  it  possible  for  the  learners 
to  activate  prior  knowledge  of  the  topic,  and  therefore,  to  engage  in  active 
elaboration  of  the  content  of  the  passage. 

NARRATIVE  VS.  EXPOSITORY:  Learners  also  seem  to  invest  mure  cognitive 
capacity  ?n  processing  narrative  text  than  expository  text  (Britton.  Graesser.  Glynn. 
Hamilton.  &  Penland.  1983)  Britton  and  his  colleagues  hypothesized  that  learners 
may  be  more  familiar  with  narrative  prose  and.  therefore,  have  better  established 
schemata  for  narrative  prose  than  for  expository  prose.  The  presence  of  well 
established  schemata  would  allow  the  learners  to  elaborate  on  the  content  in  more 
detail.  The  elaboration  process  would  fill  the  learners  cognitive  capacity  more 
completely  and  would  potentially  result  in  an  increased  number  of  inferences 
based  on  the  content. 

LEARNER  EXPECFATIONS  OF  IMMEDIATE  VS  DELAYEDTIST  Britton  (1980) 
found  that  students  that  expected  a  del?    ^  test  invested  greater  effort  in 
processing  the  lesson  than  students  that  expected  an  immediate  test.  It  is 
interesting  to  note  that  recall  scores  were  similar  for  both  groups,  however,  as 
previously  stated,  achievement  gains  from  increased  mental  effort  may  not  bs 
evident  on  a  test  of  recall. 

Conclusion 

This  paper  has  attempted  to  review  the  current  literature  on  pr^'conceptions 
of  media  and  oa  the  relationship  of  learner  preconceptions  to  the  amount  of  mental 
effort  invested  in  a  learning  task.  It  has  been  suggested  that  methods  that  increase 
the  cognitive  capacity  used  in  processing  text  based  lessons  be  investigated  to 
determine  their  potential  for  overcoming  learners'  preconceptions  of  television  as 
a  passive  medium  requiring  little  mental  effort. 

Additional  research  that  examines  the  relationship  of  leaner  preconceptions 
of  '  newer  media  (such  ai  computers)  to  the  amount  of  mental  effort  investeti  in  the 
learning  task  may  also  bo  )f  value.  Krendl  (1986)  has  suggested  that  learner 
preconceptions  of  computers  do  not  follow  the  pattern  suggested  oy  Salomon  in  his 
investigation  of  learner  preconceptions  of  print  and  television,  indicating  that 
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Hirther  research  is  aeeded  in  tb 's  area  Ic  is  possible  that  learner  preconceptions 
of  "new"  media  may  change  as  the  learners  engage  in  the  process  of  becoming 
familiar  with  the  media. 

It  is  hoped  that  further  research  on  the  issues  identified  in  tbis  paper  will 
provide  valuable  information  that  vill  have  practical  applications  for  the  design  of 
more  etfective  vtdeo-based  instruction 
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Overview 

This  article  will  present  a  perspective  of  the  current 
state  of  technology-assisted  instruction  integrating  computer 
language,  artificial  intelligence  (AI) )  and  a  review  of 
cognitive  science  applied  to  instruction. 

In  the  past  decade  the  availability  of  the  microcomputer 
in  educational  technology  has  increased  at  a  phenomenal  rate. 
Today  almost  every  student  in  the  United  States  has  access  to 
a  microcomputer.  Routinely,   instruction  is  included  in  the 
curriculum  on  computer  literacy  and  higher  level  languages 
such  as  BASIC,  LOGO,  F^^ChL  and  C,  The  age  of  the 
microcomputer  and  enhanced  educational  technology  has 
arrived.  At  least,  the  technology  has  arrived;  unfortunately 
the  hardware  appears  to  lead  the  market,  while  use  of  the 
technology  for  improving  learning  lags  far  behind.  Courses  on 
computer  literacy,  languages,  and  the  relatively  few  good 
educational  software  programs  are  beneficial,  however,  these 
courses  do  not  meet  the  tremendous  potential  that  educational 
technolcgy  offers  in  assisting  educators  and  researchers  in 
the  quest  to  improve  learning. 

The  need  for  basic  research  using  this  technology  along 
with  its  essential  attributes  is  of  paramount  importance  if 
the  situation  described  above  is  to  be  improved 
substantially.  No  longer  are  educators,  students  and  parents 
going  to  be  elated  with  fancy  graphics,  a  barrage  of  games, 
and  relatively  useless  computer  programs  that  do  little  more 
than  a  workbook.  The  goal  of  the  use  of  the  microcomputer  and 
technology  should  be  one  of  improving  learning  based  on  sound 
educational  theory. 

The  Language  of  Instructional  Technology 

A  programming  language  (to  include  authoring  systems) 
has  at    least  three  goals:  1)  it  is  a  design  tool;  2)  it  is  a 
vehicle  for  human  communication;  and  3)  it  is  a  vehicle  for 
instructing  a  computer. 

In  the  first  of  these  goals,  the  programmer  or  designer 
must  determine  an  overall  strategy  that  will  accomplish  the 
instructional  objectives.  The  designer  must  choose  a 
structure  that  will  be  correct,  efficient,  and  amenable.  For 
practical  reasons,  the  design  is  restricted  by  hardware 
(memory,  processor,  secondary  storage,  and  language) .  When 
the  process  of  design  becomes  inore  defined,  the  computer 
language  becomes  more  important.     The  language  shapes  the  way 
in  which  the  designer  thinks  about  problems, as  does  the 
computer  language  chosen.    Programming  languages  serves  as  a 
communication  medium  between  designer  and  program.  First  a 
designer  must  delineate  what  the  intended  instructional 
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program  is  to  do.  Too  often  the  language  will  make  the 
designer/programmer  concentrate  on  the  "how"  instead  of  the 
"what".  The  ability  to  understand  this  paradox  is  crucial. 
The  question  is  should  every  conceivable  useful  construct  be 
contained  in  the  language  or  should  the  language  contain  the 
constructs  that  are  just  right  for  the  program/problem  at 
hand?  This  decision  should  be  based  on  the  competency  of  the 
designer  and  the  purpose  of  the  instructional  program.  The 
computer  must  be  given  the  instructions  if  the  program  is  to 
run  with  reasonable  space^  time  and  efficiency.  The  above 
would  seem  to  be  an  relatively  easy  problem  to  deal  with.  The 
reality  is  that  what  is  reasonable  in  a  language  is  not 
always  efficient.  Difficult  and  unexpected  efficiency 
problems  typically  arise  not  from  a  single  language  featurer 
but  rather  from  a  combination^  an  interaction  of  several 
features^  in  which  each  feature  seemed  reasonable  by  itself. 
Choosing  the  proper  balance  between  features  is  what  has 
often  turned  out  to  be  more  difficult  than  expected. 
Software.  Basically  the  requirements  of  software  can  be 
thought  of  in  four  areas:  degrees  of  software  complexity^ 
degree  of  software  structurednesSr  degree  of  software 
requirements^  and  degree  of  i?oftware  reliability. 

Technoloav  Assisted  Tnal-rnr^tion  uainp  Artlfintal  Tntelllgence 

The  formal  study  of  AI  In  computer  science  can  be  trace 
to  the  early  1960s  (Feigenbaum  s  Feldman,  1963) .  The  focus 
was  on  the  design  of  computer  programs  that  would  enhance 
decision  making,  as  well  as  storing  and  retrieving 
intormation.  Early  attempts  in  cognitive  science  to  simulate 
the  brain  with  computer  models  stimulated  interest  in  how  to 
simulate  decision  making  by  experts  (Amarelr  1969) .  The 
application  of  AI  in  education  came  through  cognitive  science 
research  on  problem  solving  (Tennyson,  1982);  For  the  last 
decade.,  artificial  intelligence    has  generated  strong 
interest  and  enthusiasm  in  industry  and  universities;  it  has 
become  an  important  component  for  research  and  development  in 
high-technology  fields.    The  phrase  "Artificial  Intelligence" 
seems  randomly  applied  in  a  wide  variety  of  contexts  by  a 
growing  number  of  people  from  diverse  backgrounds.    At  issue 
is  the  nature  itself  of  what  is  called  intelligent, let  alone 
whether  a  machine  can  be  intelligent  (Schank, 1980) , (Whaland, 
1981) , (Weizenbaum,  1977)  , (Green,  1984).    A  question  arises 
of  whether  rules  and  maxims  of  a  general  nature  exist  and 
wh^-'her  they  are  applicable  across  domains  (Goldstein,  1975), 
(Sxmon,  1969),    (Glasser,  1984).  Other  issues  related  are  the 
questions  of  can  a  machine  emulate  human  intelligence,  or  is 
human  intelligence  emulation  necessary  (Hayes-Roth,  1977)? 
The  public  perception  has  focused  on  the  "artificial". 

Computers  (machines)  are  performing  feats  that  we  never 
dreamed  of.  The  ccntputer  science  community  is  constantly 
expanding  the  usefulness  and  power  of  their  machines.  This 
fact  Is  Important  in  science  and  engineering,  but  not  in  AI. 
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Most  good  AI  programs  aren't  terribly  useful r  ard  many 
usefulr  "smart":  programs  aren't  AI  at  all.  If  this 
distinction  were  understood^  we  could  avoid  a  lot  of 
confusion  and  disappointment  (Schank^  1980) . 

Artificial  Intelligence  Principles  Applied  to  Tnafruction 

AI  systems  can  take  many  forms^  but  essentially  they 
arrange  various  components  of  an  instructional  system  by 
using  AI  principles  and  techniques  in  a  way  which  allows  both 
the  student  and  the  program  flexibility.     However^  in  most 
applications  AI  systems  act  on  the  basis  of  preentered 
questions,  anticipated  answers ^  prespecified  branches^  and  to 
some  extent  on  the  structure  of  domain  knowledge  and  the 
student's  representation  of  the  knowledge  (Feigenbaum,  1977)^ 
(Brown,   1977) . 

Natural  language  has  become  an  important  feature  of  many 
AI  systems,  thus,  allowing  the  student  to  generate  questions 
and  corresponding  answers  through  a  natural  dialogues  with 
the  system.   (Carbonell,  1970),   (Waldrop,  1984),  (Rosenberg, 
1977) .    The  goal  then  of  AI  systems  is  to  improve  decision 
making,  improve  learning,  while  increasing  the  accumulation 
of  kno\%*  :dge  with  experience  (Nelison,  1971) ,  (Tennyson, 
1984)  .  How  this  goal  is  reach  and  by  what  method,  and  how 
effectively  the  system  operates  becomes  the  essential 
question  in  evaluating  AI  systems.  The  operational  functions 
of  an  AI  system  can  be  determined  by  three  main  components: 
The  content  (or  information  to  be  learned,  the  instructional 
strategy,  and  a  mechanism  for  understanding  the  student's 
current  knowledge  state.  These  components  are  referred  to  as 
the  expertise  module,  the  student -model  module,  and  the 
tutoring  module  (Clancey,  Barnett  &  Cohen,  1982).  Ideally, 
an  expertise  module  should  have  its  own  problem-solving 
expertise  as  well  as  static  knowledge  of  the  subject  matter; 
a  student -model  should  have  its  own  diagnostic  capabilities, 
and  the  tutoring  module  should  be  able  to  provide  intelligent 
learning  guidance  with  its  own  explanatory  capabilities 
(Tennyson  (  Park,  in  press) .    Early  AI  system  mainly  focused 
on  representation  of  the  domain  knowledge.  Since    the  mid- 
1970s,  however,  modeling  the  students'  learning  behavior  and 
tutorial  strategies  for  presenting  the  materials  have  been 
some  of  the  main  issues  in  the  development  of  AI  systems 
(Sleeman  &  Brown,  1982) . 

Cognitive  Science  Paradigm  Annlied  to  Tnatirucf  inn 

Given  the  memory  and  calculation  capabilities  of 
computers,  it  is  possible  to  consider  Computer  Based 
Instructional  (CBI)  syrtems  that  exhibit  elements  of  machine 
intelligence  (that  is,  the  ability  to  use  new  information  to 
update  files  and  refine  the  decision-making)  in  contrast  to 
conventional  CBI  systems  which  offer  only  "dumb"  management 
systems  (for  example,  branching  or  looping  programs  that  only 
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consider  at-the-moment  information) .     Intelligent  Computer 
Based  Instruction  can  be  characterized  as  follows:  (a) 
provides  an  initial  diagnostic  assessment  of  each  learner  in 
reference  to  a  given  learning  task^  followed  directly  by  a 
prescriptive  instructional  treatment;   (b)  gives  a  continuous^ 
on-task  assessment  that  iteratively  updates  the  diagnosis  and 
prescription;   (c)  determines  the  amount  of  instruction  based 
on  learner  progress  toward  mastery  of  the  learning 
objectives;   (d)  selects  the  sequence  of  instruction  by  a 
response-sensitive  strategy  according  to  cognitive  processing 
needs;   (e)  adjusts  the  moment-to-moment  instructional  time  so 
as  to  reduce  off-task  learning  time^  thereby  improving  the 
on-task  learning  time  ratio;  and  (f)  provides  continuous 
advisement  to  the  learner  on  learning  progress  and  learning 
need(s) . 

Initial  work  on  the  MAIS  began  in  reference  to  designing 
an  adaptive  instructional  strategy  for  concept-learning 
(Tennyson^  1975) .  The  combined  work  on  adaptive  variables  and 
concept-learning  has  evolved  into  two  major  lines  of  inquiry 
—  both  independent  but  highly  supportive  of  the  other.  As 
investigations  of  the  phenomena  of  concept-learning  and  rule- 
learning  progressed^  the  sophistication  of  the  MAIS  has 
increased  along  with  the  understanding  of  human  factors 
interacting  with  computer  technology.  The  concept-learning 
theory  followed  in  the  empirical  testing  of  the  MAIS  is  a 
two-stage  process  of  prototype  formation  and  classification 
skill  development  (see  Tennyson  &  Cocchiarella^  in  press) • 
Concept-learning  is  fundamental  to  the  acquisition  of 
knowledge  and  the  development  of  problem-solving  skills;  thus 
it  is  highly  important  that  learners  successfully  acquire 
conceptual  information  in  as  effective  a  manner  as  possible 
(Shumway^  White^  Wilson^  &  Brombacher^  1983) •  From  the 
beginning  of  the  research^  it  was  recognized  that  attributes 
of  the  computer  had  the  potential  for  handling  the 
instructional  variables  necessary  for  concept  teaching  while 
meeting  the  goal  of  attending  to  individual  differences.  This 
adaptive  instructional  system  is  formed  from  the  interaction 
of  learning  theory^  structure  of  information^  and  attributes 
of  the  computer-based  delivery  system. 

The  main  variables  of  the  MAIS  are  six  conditions  of 
instruction:  a)  amount  of  instruction^  b)  sequence  of 
instruction^  c)  display  time  interval^  d)  advisement^  e) 
embedded  refreshment  and  remediation^     and  f)  format  of 
information  (examples) .     The  above  conditions  of  instruction 
represent  the  means  by  which  the  MAIS  interacts  with  learning 
theory^  information  structure^  and  delivery  systems.  The 
philosophy  of  the  MAIS  follows  a  cognitive  psychology  theory 
of  learning  that  applies  specifically  to  the  memory  processes 
of  information  storage  and  retrieval.  Briefly^  the  cognitive 
learning  theory  of  the  MAIS  holds  that  knowledge  acquisition 
is  best  accomplished  through  experience  —  both  of  an 
expository  (statement)  form  end  interogatcry  (question)  form; 
also,  that  using  knowledge  for  problem-solving  and  creative 
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thinking  requires  practice.  Furthermore^  learning  is  viewed 
as  a  range  of  cognitive  processing  proceeding  from  the 
acquisition  conceptual  knowledge  and  skills  to^  finally, 
acquisition  of  the  ability  to  generate  new  knowledge 
(productive  thinking) . 

Formally  designed  and  controlled  instructional  systems 
seem  to  offer  the  best  means  for  facilitating  learning  during 
the  initial  and  transition  stages,  while  less  formal  systems 
offer  more  suitable  means  for  the  higher  levels  of  productive 
thinking.  In  operation,  the  MAIS  focuses  on  the  transition 
area  of  learning  (especially,  the  learning  of  concepts  and 
rules),  although  the  intention  is  that  the  MAIS  offers  a  more 
efficient  means  for  the  initial  acquisition  of  knowledge. 
Because  learning  at  the  highest  level  of  cognition  is  not  the 
acquisition  of  new,  external  knowledge  but  the  use  of 
existing  knowledge  in  producti re  thinking,  other  less 
structured  instructional  experiences  seem  to  be  more 
appropriate  (for  example,  computer-based  simulations) .  The 
remainder  of  this  section  will  define  the  theoretical  basis 
of  the  MAIS  according  to  each  of  the  conditions  of 
instruction. 
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Dstract:  Research  into  the  visual  effects  of  screen  designs  has 
been  slow  in  developing.  The  paper  examines  the  current  state  of 
that  research  and  suggests  some  avenues  for  future  efforts.  The 
basic  theme  is  that  changes  in  screen  designs  are  small,  though 
significant  factors  in  the  design  of  lessons.  As  small  factors,  it  is 
unrealistic  to  expect  major  learning  gains,  instead  researchers  should  I 
lookfor  small  changes  in  learner  behaviors  or  processes.  | 


Introduction 

Imagine  David,  with  a  sling,  against  Goliath. 
Imagine  David  standing  over  Goliath.  Now, 
imagine  David,  without  a  sling,  against  Go- 
liath. Imagine  Goliath  standing  on  David. 

David,  an  unknown  youth,  was  able  to 
knock-off  Goliath  and,  as  a  result,  continue 
to  grow  and  to  make  an  impact  on  his  era. 
But,  without  the  proper  tool,  i.e.,  a  sling,  the 
outcome  could  have  been  much  different. 
It's  not  that  David  wasn't  any  good  or  *hat  he 
didn't  have  anything  to  offer,  it's  juit  that 
without  the  sling,  David  wouldn't  have  had  a 
chance  to  become  king,  to  lead,  to  grow,  or 
to  change  things.  However,  tnith  or  legend 
be  told,  David  had  a  major  tool  and  as  a  result 
made  a  major  impact. 

More  recently,  there  came  about  the  develop- 
ment of  an  instructional  technology  called 
"programmed  instruction."  Research  into 
this  technology  led  to  findings  that  had  major, 
impacts  on  the  way  instruction  is  designed. 
Generally,  one  of  the  most  important  ideas  to 
come  out  of  the  development  of  programmed 
instruction  was  "planning"  —  the  application 
of  learner  and  task  analyses  and  tehavioral 
objectives  was  a  significant  change  in  the 
way  instruction  had  been  developed.  By 


significant,  I  mean  an  impact  that  could  be 
measured  in  terms  of  gains  in  post-te«t  per- 
formance. 

It  seems  logical  and  obvious  to  assume  (hat  a 
significant  intervention  leads  to  a  significant 
result.  Hit  a  nail  with  a  hammer  with  full 
strength  and  you  expect  to  see  a  gross 
adjustment  in  its  height.  On  the  other  hand, 
molecular  interventions  lead  to  molecular 
changes.  Hit  a  nail  with  a  pair  of  pliers 
ins^icad  of  a  hammer  and  you  expect  to  see 
only  a  minor  adjustment  in  height.  Yet,  in 
the  world  of  instructional  technology,  this 
same  logic  is  not  as  obvious  as  in  the  world 
of  physics.  In  instructional  technology, 
when  we  conduct  an  experiment  which,  in 
effect,  is  designed  to  produce  only  a  minor 
change,  we  act  surprised  when  the  results  are 
not  "major  league." 

Return  to  David  and  Goliath.  Imagine  David 
as  he  approaches  Goliath  with  a  stone,  but  no 
sling.  When  we  imagine  David  with  a  sling 
we  "expect*'  David  to  succeed  (we've  been 
conditioned  by  the  legend).  But,  when  we 
think  about  David  without  the  sling,  our  ex- 
pectations are  reduced  and  a  large  element  of 
doubt  enters  the  picture.  Maybe  David  can 
get  in  a  lucky  thiow.  Maybe  David  can  do 
some  damage  and  get  out  before  he's 
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damaged.  The  point  is,  we  reduce  our 
expectations  of  results  when  the  intervention 
loses  strength. 

In  educational  research,  we  often  have  great 
expectations  for  minor,  though  not  unimpor- 
tant, interventions.  For  whatever  reasons 
(publication  demands,  ego,  or  lack  of 
creativity),  when  we  attempt  educational 
research  we  try  all  kinds  of  small, 
controllable  interventions  but  cling  to  molar 
effects  on  learning  as  cur  expectation  or 
measure  of  change.  The  area  of  screca  layout 
design  is  a  case  in  point. 

Limitation:  The  Visual  Impact 
of  Screens 

Screen  layout  design  refers  to  the 
arrangement  of  design  elements  on  a  screen. 
These  elements  are  numerous,  as  shown  in 
Tables  1  and  2.  This  paper  is  limited  to  a 
discussion  of  these  elements  as  used  in 
layout.  Layout  is  a  publication  design  term 
used  to  refer  to  the  planned,  visual 
arrangement  of  text  elements  on  a  page  or 
screen.  The  elements  listed  in  Tables  1  and  2 
fall  into  two  general  classifications:  technical 
elements  and  comprchensibility  elements. 

Technical  Elements 

Technical  screen  design  elements  are 
those  things  that  engineers  work  with  and 
that  users  have  little  or  no  control  over.  They 
are  factors  that  are  built  into  the  equipmeiit  or 
factors  that  can  be  controlled  by  lighting,  or 
contrast  and  brightness  controls. 

A  great  deal  of  research  has  been  performed 
investigating  the  human  factors  effects  of  the 
technical  elements  of  a  display.  A  discussion 
of  this  research  is  beyond  the  scope  of  this 
paper  because  the  display,  as  constructed,  is 
what  we  (instructional  technologists)  have  to 
work  with.  However,  it  should  be  noted  that 
this  is  not  a  static  field.  Research  is  continu- 
ally going  on  to  determine  the  best  screen 
size,  resolution,  background  colors, 
brightness,  etc.  In  the  field  of  legibility,  this 
type  of  research  is  referred  to  as  "visibility" 
research.    Its  focus  is  to  determine  the 


characteristics  that  make  a  display  and  its 
symbols  most  visible. 

Comprehensibility  Elements 

Comprehensibility  screen  design  ele- 
ments  are  those  elements  that  a  designer, 
publisher,  or  programmer  can  control.  I  use 
the  term  "comprdhensibility"  because  the  use 
of  these  elements  effect  the  readability  and, 
ultimately,  learner  understanding  of  the  con- 
tent. Isaacs  (1987)  states  that 

The  functions  of  a  G\L  lesson  screen 
are  to  present  information  to  a  student 
and  to  evince  and  receive  responses 
from  that  student ....  we  must  also 
see  that  the  student  receives  informa- 
tion of  a  facilitative  nature — informa- 
tion to  help  the  student  use  the  system 
....  (p.  47) 

Each  comprehensibility  element  has  a 
potential  effect  on  the  readability  and 
understanding  of  the  document.  As  Table  2 
shows,  there  are  a  large  number  of  factors. 
This  number  goes  beyond  the  sum  of  discrete 
elements  because  of  the  number  of 
combinations  available.  Five,  six,  seven,  ten 
or  more  of  these  factors  may  be  operating 
together  at  any  one  time  in  a  display,  com- 
pounding and  confounding  signiflcantly  the 
research  problem. 

It  is  an  interesting  area  of  study,  because 
there  seems  no  shortage  of  overall  screen 
design  recommendations  on  how  to  combine 
the  comprehensibility  elements.  These 
recommendations  are  usually  general 
heuristics,  such  as  use  lots  of  open  space, 
use  highlighting,  be  consistent  between 
screens,  keep  one  topic  to  a  screen,  keep  the 
screens  simple  and  avoid  clutter.  (Isaacs, 
1987;  Kearsley,  1985;  Lundeen,  1982;  Ng, 
1986;  Kambally  and  Rambally,  1987). 

Many  of  these  recommendations  are  based 
upon  research  that  examined  the  effects  of 
single  elements.  For  example,  directive  cues, 
such  as  underlining,  highlighting,  or  bold 
type,  facilitate  search  tasks;  or,  headings  in 
question  form,  can  facilitate  learning  of 
essential  information.  However,  heuristics 
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Table  1 

Technical  Screen  Design  Elements 


Typographic  Factors 

symbol  height 

symbol  width-to-heighi  ratio 
Environment 

glare  and  reflections 
viewing  angle 
visual  fatigue 


symbol  resolution 
Many  of  the  items  listed  in  this  table  are  from  Dwyer  (1985). 


Screen  Factors 

dot  matrix  size 

chromacity 

contrast  ratio 

dot  shape  and  spacing 

flicker 

resolution 

horizontal  symbol  spacing  vs. 
dot  generated  symbols 
stroke  width 
luminance 


Table  2 

Readability  Screen  Design  Elements 


Typographic  Factors 

line  spacing 
line  length 

leading  (vertical  line  spacing) 
size  of  letters 
font  characteristics 
case  of  letters 

Organization  Factors 

paragraph  indication 
graphic  devices 
figure/ground  separation 
headings 


Cueing  Factors 

highlighting 
color 

case  changes 
graphic  devices 


Control  Factors 

icons 

command  bars 
status  bars 
maps 
scrolling 
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such  as  "avoid  clutter/*  "use  lots  of  open 
space,"  and  "be  consistent"  are  open  to  inter- 
pretation .  These  types  of  recommendations 
are  usually  based  on  folklore  and  design 
practices  developed  from  the  visual  arts. 
Recommendations  about  the  best  ways  to 
c(»nbine  several  elements  stiU  n^  to  be  re- 
searched. 

Single  Element  Research; 

As  a  result  of  research  into  the  effects  of  sin- 
gle screen  design  elements,  we  can  make 
generalizations  about  the  uses  of  directive 
cues,  headings,  indentation,  line  length,  type 
size,  and  leading.  Originally,  much  of  this 
research  was  based  on  print  (hard  copy*) 
studies,  but  the  past  years  have  seen  more 
and  more  research  aimed  specifically  on  the 
application  of  these  elements  to  \ideo  display 
terminals. 

The  focus  upon  video  display  terminals  has 
helped  provide  suggestions  for  using  at- 
tributes specific  to  screen  displays.  For  ex- 
ample, color  is  a  feature  that  is  expensive  to 
implement  in  hard  copy,  but  costs  nothing  on 
color  display  screens,  TuUis  (1981)  found 
that  color-coding  proved  superior  to  narrative 
format  when  teaching  adults  to  discriminate 
among  different  signals  that  required  some 
sort  of  action  or  interpretation.  On  the  other 
hand.  Baker  (1986)  pointed  up  a  significant 
problem  with  the  use  of  a  program  designed 
to  use  color  on  a  monochrome  display. 
Baker  found  that  children  were  unable  to 
discern  critical  features  of  a  color  graphic 
displayed  on  a  monochromatic  monitor 
unless  it  was  designed  to  enhance 
figure/ground  separation. 

Single-element  research  is  extremely 
important  in  identifying  the  strengths, 
weaknesses,  and  potential  problems  of  using 
specific  attributes  on  CRT  screens.  Tuerc  are 
a  wealth  of  topics  specific  to  computer 
displays  that  need  to  be  examined:  single  and 
multiple  windows,  navigation  aids,  icons, 
scrolling,  etc.  Single  element  research  is  a 


*  Hard  Copy:  refers  to  paper  documents,  such 
as  books  or  articles. 


necessary  first  step  in  understanding  how  to 
combine  these  elements  into  overall  displays. 

>/lultiple  Element  Research: 

Despite  research  into  individual  screen  design 
factors,  there  is  a  dearth  of  research  into  ef- 
fects of  combinations  of  these  factors.  Multi- 
element research  tends  to  be  more  complex 
than  single-element  research.  Examination  of 
single  text  elements  usually  stops  with  that 
element  and  its  effects  on  narrowly  defined 
tasks.  But  the  exa*xiination  of  combinations 
of  elements  involves  not  just  the  text 
elements,  but  the  perceptions  of  the  Viewers 
also.  It  is  not  just  a  question  of  functionality, 
but  cognitive  effects  as  well.  That  the  overall 
appearance  of  a  screen  has  an  affect  on 
viewer  preferences  was  found  by  Champness 
and  DiAlbeidi  (1981)  and  Grabinger  (1984, 
1987).  Champnes.<2  and  DiAlberdi  examined 
the  affects  of  informational  screens  used  in  an 
implementation  of  videotext  for  voluntary 
users  and  found  screen  preferences  that  were 
classified  into  factors  labeled  attractiveness, 
clarity,  and  usefulness.  Grabinger  had 
student  viewers  examine  content-free  models 
of  screens  intended  for  instruction  classified 
viewer  preferences  into  factors  labeled 
simplicity,  structure,  and  organization. 

The  main  point  is  that  the  visual  "gestalt"  of  a 
screen  has  an  affect  on  learner  preferences. 
These  preferences  are  formed  from  percep- 
tions, perceptions  that  may  also  affect  cogni- 
tive processes.  The  next  logical  question, 
then,  is  whether  this  affective  response  also 
effects  the  processes  a  learner  chooses  to  use 
while  studying  the  material. 

The  processes  and  activities  a  student  uses  to 
learn  are  referred  to  as  macroprocesses  by 
Tobias  (1984).  Tobias  defines  macropro- 
cesses as 

. . .  those  relatively  molar  cognitive 
processes  students  use  when  they 
learn  from  meaningful  instructions, 
such  as  reviewing,  previewing, 
looking  for  clarification,  and  the  like. 
Macroprocesses  .  . .  denote  only  the 
cognitive  processes  used  by  students 
to  leam  from  instruction,  (p.4) 
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Ibbias  (1984)  goes  on  to  state  that,  "one  as- 
sumption of  instructional  research  in  general 
is  that  alternate  methods  induce  different 
types  of  macroprocessing  (p.  5)." 

The  goal  of  research  into  the  overall  visual 
effect  of  the  screen,  then,  is  to  identify 
macroprocesses  effected  by  screen  layout 
arrangements.  Hopefully,  by  becoming 
aware  of  these  activities,  we  can  then  identify 
specific  designs  to  help  control  or  enhance 
them. 

The  Problems  of  Research  into 
the  Overall  Design  of  a  Screen 

And  that  brings  up  a  major  research  problem. 
How  do  we  identify  the  effec'ts  of  a 
confusing  combination  of  text  elements  and 
processes  that  are  not  physically  visible? 
There  are  two  main  problems  that  arise  with 
this  question.  First,  the  changes  and  effects 
of  the  appearance  of  a  screen  are  molecular  in 
terms  of  the  overall  instructional  process. 
Second,  as  is  always  the  case  when  trying  to 
work  >^ith  cognitive  processes,  the 
cerebrascope  that  examines  the  brain  directly 
has  not  yet  been  invented,  so  research  must 
rely  on  inferences. 

For  example,  in  a  recent  study  (Grabinger 
and  Albers,  1988)  two  fundamentally 
different  screen  designs  were  used  in  CAI 
programs  for  fourth  grade  students.  One 
version  incorporated  plain  text  without  color, 
graphic  devices,  highlighting,  or  other  design 
enhancements.  The  other  version  was 
designed  to  incorporate  indentation, 
highlighting,  command  bars,  and  boxes  to 
make  the  screens  appear  more  organized  and 
structured.  Dependent  variables  were 
immediate  recall  following  the  treatment, 
retention  of  material  after  a  two-week  delay, 
and  average  time  spent  on  each  screen.  There 
were  no  differences  between  versions  in 
recall  or  retention.  There  was,  however,  a 
difference  in  average  time  spent  per  screen 
with  one  of  the  enhanced  versions.  It  was 
inferred  from  this  difference  in  average  time- 
per-screen  that  some  different  kinds  of 
processing  were  occurring  as  a  result  of  the 
altered  screen  design.  It*s  an  inference  based 


on  a  small  effect  and  one  that  is  open  to 
interpretation,  but  an  effect  that  may  stimulate 
further  research. 

Two  possible  conclusions  may  be  drawn 
from  this  study.  First,  because  of  ±c  lack  of 
learning  gains,  it  could  be  concluded  that  the 
overall  visual  design  of  the  screen  has  little 
effect  on  macroprocesses.  This  is  a  possibil- 
ity, because  research  regarding 
macroprocesses  has  discovered  that  students 
arc  not  good  at  making  decisions  about  which 
processes  to  employ  or  when  to  employ 
them.  Lower  ability  students  tend  to  employ 
learning  strategies  infrequently,  while  higher 
ability  students  tend  to  employ  too  many  too 
frequently  (Tobias,  1985)**.  The  design  of 
a  screen  may  suggest  something,  but  it  may 
no:  be  explicit  enough  for  most  students. 
The  purpose  of  design  elements  must  be 
explained  to  students  before  they  are 
encountered  for  them  to  have  any  effect 
(Fitzgibbon  and  Patrick,  1987). 

A  second  possible  conclusion  is  that  the  re- 
search methodologies  and  measures 
employed  are  not  sensitive  enough  to 
measure  the  effects.  In  an  effort  to  look  at  as 
many  possible  factors  as  possible  Grabinger 
and  Albers  also  added  variables  such  as  type 
of  task  (conceptual  application  or  recall)  and 
prior  information  about  the  screens.  This 
may  be  a  good  multivariate  design,  but  it  also 
tends  create  so  many  cells  in  MANOVA 
designs  that  small  scale  effects  become  even 
smaller  as  degrees  of  freedom  rise. 

The  basic  argument  is  that  we  need  to 
concentrate  more  precisely  on  the  effects  of 
screen  designs  on  learner  actions  and 
processes,  not  just  the  major  effects  on 
learning.  This  is  not  to  relegate  the 
importance  of  learning  to  the  closet. 
Learning,  after  all,  is  the  primary  goal  of  all 
instructional  research.  However,  the  point  is 
that  we  must  firi;t  identify  ways  in  which 
cognitive  processes  are  effected  and  then  try 
to  identify  ways  to  control  or  to  enhance 
them.  It  is  only  when  we  can  exert  some 


Training  stiKlcnts  in  the  use  of  macroprocesses 
has  positive  effects,  as  does  explicit  instructions  to 
use  a  specific  type  of  strategy. 
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control  over  the  processes  that  we  can  then 
make  statements  aix)ut  how  that  control  may 
be  exerted. 

Two  examples  of  this  effort  to  identify  effects 
on  smaller  learner  behaviors  were  described 
earlier  in  Tullis  (1981)  and  Baker  (1986).  In 
their  research  regarding  the  effects  of  color 
they  found  significant  features  that  will  effect 
design  decisions.  They*re  measures  of  effect 
were  on  search  tasks  and  perceptibility.  Both 
of  those  dependent  variables  represent  activi- 
ties that  are  smaller  activities  in  the  learning 
process.  If  they  had  relied  on  gross  learning 
instead  of  smaller  actions  such  as  discrimina- 
tions and  perceptibility,  their  research  may 
not  have  found  anything. 

In  another  example,  Haas  and  Hayes  (1985) 
compared  the  ability  of  students  to  find 
previously  read  information  in  paper,  CRT 
and,  large  CRT  versions.  Rather  than  using 
learning  as  the  primary  indication  of  effect, 
they  used  student  estimates  of  target  sequence 
and  vertical  and  horizontal  location.  Their 
fmdings  indicated  that  the  more  a  student  sees 
at  one  time  and  the  less  a  body  of  text  is 
broken  up,  the  better  they  remember  where 
material  is  located  in  the  text. 

What,  then,  can  we  use  as  dependent 
variables  in  investigating  the  visual  effect  of 
screen  designs?  Some  of  the  following 
measures  may  prove  useful: 

Audit  trails.  Implementations  of  hy- 
pertext and  navigation  options  in  tra- 
ditional CAI  programs  leave  users 
with  a  number  of  alternatives  in  how 
they  "travel"  through  a  program. 
Tracking  a  user*s  movements  may 
provide  information  both  about  the 
program's  and  student's  cognitive 
structure. 

Eye  movements.  Saccade  amplitude 
and  fixations  provide  physical  evi- 
dence of  a  user's  response  to  a  spe- 
cific design.  This  can  provide  infor- 
mation about  the  salience  of  specific 
design  features,  such  as  boxes,  com- 
mand bars,  and  hierarchical  struc- 
tures. 


Time.  Time-per-screen  and  time-per- 
program  may  provide  some  indication 
of  processing  activity.  This  may  be 
either  positive  or  negative,  for  a  de- 
sign that  is  too  complex  may  increase 
time  because  of  cognitive  overload. 
On  the  other  hand,  a  design  that  en- 
courages deeper  processing  of  essen- 
tial infonnation  may  also  increase  the 
time  a  student  spends  with  a  screen  or 
program. 

Subjective  evaluations.  User  evalua- 
tions of  screens  in  terms  of  helpful- 
ness, aesthetic  quality,  organization, 
and  structure  are  some  of  the  qualities 
that  may  be  used  to  provide  informa- 
tion for  the  development  of  user-ori- 
ented screen  design  guidelines. 

Search  time  and  accuracy.  Specific 
tasks,  such  as  searching  for  some- 
thing specific  on  the  screen  can  be 
measured  in  time  and  accuracy  to 
provide  information  about  the  quality 
of  organization  or  highlighting. 

Generative  and  reproductive  out- 
comes. Outlines  and  graphic  organi- 
zers can  be  used  to  get  a  subsequent 
"picture"  of  the  effects  of  a  design  on 
a  students  own  mental  organization  of 
the  information. 

Use  of  supplementary  aids.  The  use 
of  help  screens,  maps,  glossaries, 
and  indices  may  provide  some  infor- 
mation about  the  ability  of  a  screen  to 
help  elicit  "investigatory"  responses 
from  the  learner. 

(This  list  is  by  no  means  exhaustive,  but 
meant  to  stimulate  thinking.) 

The  other  problem  in  the  research  on  the  vi- 
sual effect  of  screens  is  in  the  area  of  identi- 
fying the  processes  learners  are  using.  This 
information  is  important  because  it  may  effect 
learning  in  both  positive  and  negative  ways. 
It  is  important  to  identify  designs  that  may 
cause  cognitive  overload  as  well  as  designs 
that  facilitate  constructive  cognitive 
behaviors. 
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In  more  operational  terms,  we  need  to 
identify  measures  that  we  can  use  to  draw 
inferences  about  lesign  effects  on  cognitive 
processes.  Of  course,  this  is  not  a  problem 
solely  in  the  realm  of  screen  design,  but  a 
tough  problem  in  all  cognitive  research.  In 
investiga^ons  that  deal  strictly  with  learning 
strategies  and  macroprocesses,  three  methods 
h:  ve  predominated: 

1)  post- lesson  interviews  of  students 
aboiit  cognitive  activities  used  in 
the  lesson  (Winne  and  Marx, 
1982); 

2)  training  of  students  in  the  use  of 
specific  strategies  and  then  follow- 
up  measures  to  identify  the  impact 
of  that  training  on  learning  or 
learning  tasks  (V/inne,  1982); 

3)  self-ratings  by  students  on  the 
amount  of  mental  effort  required 
for  the  learning  task  (Salomon, 
1982). 

All  three  of  those  methods  may  prove  useful 
in  the  investigation  of  ovmdl  screen  designs. 
Other  techniques  may  be  possible  using  gen- 
erative and  reproductive  outcomes,  multidi- 
mensional scaling,  and  factor  analysis  of 
audit  trails  and  preferences. 

Finally,  after  we  find  signs  that  certain  lypes 
of  screen  designs  effect  student  processing, 
then  we  must  investigate  the  effects  of  those 
processes  on  learning.  For  example,  if  a 
highly  structured  screen  design  improves  the 
quality  of  student  outlines,  has  this 


supplanted  their  own  processes  and  inhibited 
learning  or  has  it  enhanced  their  learning  by 
improving  their  own  organization?  What 
kinds  of  students  are  these  effects  on?  Is  age 
important?  What  about  training  in  the 
meaning  of  the  features  of  a  screen  design 
type? 


Conclusion 

At  this  point  in  time,  all  we  can  say  about 
screen  design  is  that  a  well-designed  CAI 
program  teaches  despite  ^e  design  of  the 
screens.  However,  this  is  something  that  can 
be  said  about  most  media  studies  and  reflects 
that  state  of  research  in  our  field.  We  are  at  a 
point  at  which  the  focus  of  our  research  ef- 
forts is  moving  into  the  human  mind.  How 
can  we  help  the  mind  function  more 
efficiently  and  effectively? 

We  have  broken  the  4:00  minute  mile.  The 
improvements  now  come  not  in  whole  sec- 
onds, but  in  tenths  of  a  second.  We  must 
design  our  research  in  such  a  way.  We  must 
look  for  the  little  things  that  make  a  difference 
in  hopes  that  when  we  put  a  lot  of  litde  things 
together  we  will  bump  another  tenth  of  a  sec- 
ond off  the  clock.  The  task  is  to  construct 
the  kind  of  research  that  will  allow  us  to  infer 
that  different  designs  will,  in  fact,  lead  to 
alternative  cognitive  processing  for  students. 
TTie  intent  of  this  paper  was  to  stimulate 
discussicm  about  a  sequence  and  organization 
that  will  facilitate  development  of  screen 
design  research. 
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AN  EXTENSION  OF  CLARK'S  MEDIA  RESEARCH  DISCUSSION 


SYMPOSIUM  INTRODUCTION 


Ba  rba  ra  L •  G  rabowsk  i 
Associate  Professor 
330  Huntington  Hall 
Syracuse,  New  York  13244 


Are  media  simply  delivery  vehicles  as  Clark  (1983)  has  suggested? 
Do  media  really  not  influence  learning?    Is  interactive  video  the 
one  medium  that  will  prove  the  age  old  argument  presented  by  many 
of  our  leaders  for  the  past  40  years  wrong?    Or,   in  fact,  v:ill 
interactive  video  be  the  one  medium  that  will  be  spared  from 
trivialized  media  comparison  studies? 

Since  the  late  70's  when  interactive  video  became  a  reality,  many 
designers  and  researchers  discussed  whether  its  existence 
represented  a  ••new"  medium  to  be  probed  and  researched  to  identify 
instructional  prescriptions  specific  to  this  medium  or  whether  it, 
in  fact/  was  jusc  another  instructional  tool  (Hannafin,  1983/ 
Grabowski,  1983,  Grabowski  &  Pearson,  1988).     During  this  same 
decade,  Clark  and  others  also  revived  an  age  old  discussion 
advising  that  the  important  prescriptions  will  come  from  research 
on  ••  instructional  strategies"  and  cautioned  against  more  trivial 
media  comparison  research  (Clark  &  Snow,  1975,  Clark,  1983,  1985, 
1987,  Clark  &  Salomon,  1987,  Clark  &  Sugrue,   1988,  Cohen,  1984). 

When  addressing  the  issue  of  the  impact  of  the  medium  of 
interactive  video  on  achievement,  we  felt  that  some  of  the 
inherent  properties  of  a  medium  must  be  considered  as  McLuhan's 
(1967)  tenet  of  "medium  instead  of  message"  would  tend  to  suggest. 
The  actual  properties  of  the  interactive  videodisc  itself  will 
according  to  Cohen  (1984)  "ultimately  dictate  the  essential  form 
of  the  message  transmitted  on  it  and  influence  the  way  a  student 
processes  the  information."    While  there  is  an  obvious  difference 
between  a  car  and  an  iconic  representation  as  McLuhan  and  Cohen 
suggest--is  there  any  real  difference  between  a  car  crash  on 
videotape  versus  a  car  crash  on  videodisc?    Using  the  same 
reasoning,  we,  then,  consider  this  argument  from  the  perspective 
of  whether  it  is  the  "singer  or  the  song"  that  will  impact  on  our 
"learning"  and  motivation  toward  learning. 

The  purpose  of  this  symposium,  then,  is  to  combine  these  two 
issues  and  reconsider  this  discussion  in  light  of  past,  and 
current  research  on  and  with  interactive  video. 
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Included  in  this  discussion  are  several  points  of  view  from  a 
general  consideration  of  Marshall  McLuhan's  the  "medium  is  the 
message"  to  potential  motivational  effects  of  the  medium.  From 
this  general  point  of  view,  we  move  to  a  specific  review  of  past 
and  current  research  on  and  with  interactive  video  to  determine  if 
Clark's  cautions  are  being  heeded  for  this  medium.     Finally,  the 
symposium  concludes  with  some  reflections  on  why  media  comparison 
studies  continue  and  suggestions  are  made  for  possible  appropriate 
areas  for  future  research. 


The  symposium  participants  include: 

Dr.  Richard  E.  Clark 

University  of  Southern  California 

Dr.  Clark,  the  most  distinguished  leader  in  this  discussion  of  the 
effects  of  media,  also  leads  off  the  symposium.     With  the  support 
of  educational  research,  he  presents  "counter-intuitive"  responses 
to  six  major  areas  of  disagreement  with  regard  to  the  use  of 
interactive  videodisc.     His  presentation  sets  the  stage  for  the 
papers  that  follow. 

Michael  A.  Yacci 

Rochester  Institute  of  Technology 

Yacci  attempts  to  bring  McLuhan*s  issues  to  the  forefront  as  he 
discusses  Clark's  argument  and  points  out  some  different  issues 
that  have  not  yet  been  resolved. 

Claudia  Pask-NcCartney 

Syracuse  Universi ty 

Pask-McCartney  extends  the  issues  of  achievement  to  issues  behind 
what  constitutes  motivation  and  whether  the  medium  affects 
motivation. 

Blisa  J.  Slee 

Syracuse  University 

The  whole  purpose  of  this  discussion  comes  to  light  with  Slee's 
presentation  on  the  state  of  the  research,  as  far  as  we  could 
analyze  in  te rms  of  reported  research .     She  has  taken  the  lead  i n 
reviewing  the  body  of  interactive  video  literature  since  1983, 
and  will  present  our  findings  from  this  review  and  analysis. 

Barbara  L.  Grabawski 

Syracuse  University 

Grabowski  then  concludes  the  discussion  by  considering  reasons 
why  we  continue  to  see  media  comparison  research  reported  in  the 
literature.     She,  then,  suggests  areas  for  future  research  with 
and  on  interactive  video. 
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Concerns  about  the  use  of  newer  media  in  education  have 
a  very  long  and  distinguished  history.    The  Greek 
philosopher  Socrates  was  reputed  to  have  criticized  the  use 
of  the  "written  word"  in  teaching,    in  his  dialogues  with 
the  slave  Meno,  he  claimed  that  only  oral  instruction, 
delivered  by  a  skilled  teacher,  could  draw  out  the  natural 
knowledge  possessed  by  all  students*    His  objection  to  the 
new  medium  of  the  written  word  was  that  it  would  make 
students  "lazy"  and  "destroy  memory".    While  the  written 
word  is  today  established  as  one  of  the  "traditional"  media 
for  education,  many  of  our  arguments  about  the  adoption  of 
newer  media  such  as  video-disk  sound  similar  to  Socrates" 
objections  to  the  written  word.    For  example,  today  there 
are  at  least  six  major  areas  of  disagreement  that  seem  to 
reoccur  as  new  media  are  available  for  teaching*    Those  six 
arguments  stem  from  questions  such  as:  1)  is  video  disk  more 
effective  than  traditional  media  (teachers  and  books)  for 
promoting  learning?;  2)  Does  the  visual  nature  of  video  disk 
technology  promote  creative  thinking?;  3)  Does  the  capacity 
of  the  video  disk  technology  to  present  more  "realistic" 
instruction  enhance  student  learning?;  4)  Are  students  more 
motivated  to  learn  from  video  disk  than  from  traditional 
media?;  5)  Does  Video  Disk  and  CBT  connections  increase 
freedom  of  choice  by  students?;  and  6)  Are  media  less 
expensive  than  teachers  for  some  types  of  education  and 
students? 

What  I  find  interesting  about  using  educational 
research  to  analyze  these  questions  is  that  the  best  current 
answers  to  many  questions  are  often  "counter-intuitive". 
The  best  current  answer  to  each  of  the  six  questions  is 
considerably  different  than  I  had  expected  when  I  began  my 
research. 
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1)  Is  Video  Disk  Technology  More  Effective  In  Promoting 
Learning  Than  Traditional  Media? 


The  best  and  quickest  answer  to  this  question  is 
"yes"...  and  "no".    Yes,  the  research  in  the  United  States, 
Canada,  Australia,  Indonesia,  Columbia,  El  Salvador  and  the 
United  Kingdom  provide  dramatic  evidence  that  television 
(and  other  new  media)  increase  student  learning  an  average 
of  20%  over  more  traditional  means  of  teaching.    Once  the 
video  disk  is  more  established  we  will  probably  find  a 
comparable  measure  of  effectiveness.    But  there  is  no 
evidence  that  the  medium  used  causes  the  learning  gains. 
Instead,  the  school  achievement  gains  are  probably  due  to 
efforts  that  accompany  the  introduction  and  use  of  new  media 
such  as  curriculum  reforms,  increased  investment  of 
resources  in  designing  lessons  and  in  preparing  students  for 
instruction.    It  takes  teams  of  specialists  to  develop, 
produce  and  present  a  video  disk  teaching  program.  Yet, 
newor  media  serve  as  an  important  "context"  in  which 
governments  and  educators  inv'zrease  the  effort  and  resources 
invested  in  education.    There  is  more  agreement  now  among 
researchers  that  the  same  learning  gains  we  measure  from 
newer  media  would  also  be  possible  with  traditional  forms  of 
instruction  —  though  our  teachers  have  had  a  very  difficult 
time  adopting  to  newer  methods  of  teaching. 

Of  course  one  of  the  claims  made  about  newer  media  such 
as  computers  and  video  disk  is  that  they  allow  for 
"interactivity"  between  student  and  teacher.    While  that  may 
be  true,  other  media  including  the  oldest  media  —  teachers 
—  provide  the  same  capacity.    Video  disks  do  not  provide 
any  form  of  interactivity  which  cannot  be  duplicated  by 
existing  technologies  even  though  such  a  duplication  in  the 
case  of  certain  instructional  messages  would  be  much  less 
efficient. 

Therefore,  it  seems  that  media  are  carriers  or 
"vehicles"  that  transport  instruction  to  students.  The 
instruction  carried  my  any  media,  new  or  old,  might  be 
effective  or  ineffective.    This  was  the  source  of  the 
analogy  I  used  in  my  1983  Review  of  Educational  Research 
article,  that  media  do  not  influence  student  learning  any 
more  than  the  truck  that  delivers  groceries  to  a  market 
influences  the  nutrition  of  the  market's  customers.  But 
media  are  interesting  and  they  attract  the  interests  of 
educational  reformers  and  workers.    Newer  media  present  the 
opportunity  to  lure  more  resources  to  education,  and  they 
permit  the  use  of  newer  instructional  methods  that  teachers 
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either  reject  or  are  too  busy  to  use.    The  greatest 
advantage  of  the  new  media  is  that  they  adopt  so  quickly  and 
easily  to  new  developments  in  Instructional  technique  and 
curriculum  change.    They  also  have  a  capacity  to  perform 
instructional  tasks  that  teachers  either  dislike  or  are 
unwilling  to  learn. 


2)    Does  the  visual  nature  of  video  disk  pr^/note  more 
creative  thinking  by  students? 

Based  on  the  great  volume  of  research  conducted  in  this 
area,  the  answer  is  clearly  "no".    Yet,  there  is  good 
evidence  from  interviews  with  famous  artists,  writers  and 
scientists  that  mental  imagery  is  important  for  creative 
thinking.    Albert  Einstein,  for  example,  reported  gaining 
insight  into  his  theory  of  relativity  when  he  imagined 
himself  being  transported  to  the  moon  in  a  Viennese  cable 
car.    As  the  car  approached  the  speed  of  light,  Einstein 
recounted  his  sirprise  that  the  car  became  narrower  and  that 
time  within  the  car  slowed  down  relative  to  the  time  back  in 
Vienna.    Accounts  such  as  this  fuel  our  imagination  and  our 
expectations  for  the  power  of  visual  thinking.  However, 
visual  thinking  might  help  creative  thought  (particularly 
for  the  educated  scientist  or  accomplished  artist)  but  there 
is  no  evidence  that  visual  media  increase  or  enhance  visual 
imagery.    In  fact,  the  evidence  suggests  that  one  does  not 
have  to  have  strong  visual  imagination  to  do  the  most 
creative  thinking.    Many  creative  thinkers  use  verbal  means 
to  "imagine"  ideas.    There  is  even  evidence  that  using 
pictures  during  reading  instruction  may  interfere  with  the 
initial  reading  skills  of  children  who  are  slow  to  read. 

Why  then  does  visual  instruction  seem  to  be  such  a 
powerful  tool  for  education  if  the  research  evidence  does 
not  support  its  use?    It  appears  that  the  formation  and  use 
of  mental  visual  images  is  not  necessarily  helped  by  visual 
instruction  but  under  some  conditions,  visual  images  seem  to 
enhance  thinking  and  problem  solving.    Visual  imagery  seems 
to  be  a  talent  that  some  of  us  are  born  with  and  others  are 
not.    People  who  are  not  able  to  have  visual  images  find 
other  means,  mostly  verbal,  to  represent  visual  events  in 
their  minds.    In  fact,  a  recent  major  study  of  visual 
imagery  and  visual  problem  solving  found  that  highly  verbal 
students  with  very  low  visual  ability  were  just  as 
successful  as  the  most  visual  students  in  solving  visual 
problems.    This  was  a  "counter-intuitive"  surprise  to  many 
psychologists.    Investigations  about  why  the  non- visual 
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studentG  were  able  to  solve  visual  problems  suggest  that 
they  made  good  use  of  analogies  and  metaphor.    It  is  my  view 
that  the  advantage  of  visual  imagery  is  that  the  "pictures 
in  our  minds*  serve  as  a  very  powerful  analogy  of  the 
problem  being  solved.    In  Einstein's  trip  to  the  moon  image, 
the  cable  car  was  a  convenient  and  concrete  analogy  for  the 
three  elements  of  the  theory  he  developed  -  mass,  velocity 
and  energy.    Such  creative  thinking  may  actually  require  the 
use  of  analogies,  some  of  which  are  visual. 

The  practical  application  of  this  area  of  argument  is 
to  notice  that  we  need  to  make  greater  use  of  analogies  in 
all  of  our  instruction.    A  recent  study  found  that  there  was 
only  minimal  use  of  analogies  in  the  textbooks  and  other 
instructional  materials  for  teaching  of  mathematics  and 
science.    Yet,  it  seems  that  the  use  of  concrete  imagery 
greatly  helps  creative  thinking  and  speeds  up  learning  about 
complex  concepts.    We  should  keep  this  in  mind  when  we 
develop  new  or  traditional  instructional  media. 


3)  Media  such  as  video  disk  present  information  that  is  more 
realistic.    Does  that  enhance  student  learning? 

During  the  1950 's  and  60 's  in  the  United  States  there 
was  a  very  famous  theory  called  the  "cone  of  experience". 
This  theory  suggested  that  the  closer  instruction  came  to 
depicting  the  way  events  were  experienced,  the  more  learning 
that  was  possible.    This  "realism",  we  argued,  was  not 
available  in  the  artificial  environment  of  most  classrooms 
but  it  was  available  from  movies  and  television.  For 
example,  many  educators  notice  that  the  printed  word  only 
presents  the  student  with  "abstractions"  of  experience, 
whereas  television  and  the  cinema  provide  information  to  a 
variety  of  senses  in  a  form  similar  to  that  encountered 
during  an  actual  experience.    The  theory  seemed  sound 
because  it  was  intuitively  correct  to  a  number  of  educators, 
myself  included.    Yet,  there  is  no  research  evidence  in 
favor  of  the  theory  and  a  considerable  amount  of  evidence 
against  it. 

Nhy  should  realism  not  support  learning?    While  there 
may  be  settings  in  which  realism  is  helpful  to  learning,  we 
have  not  yet  discovered  them.    The  psychological  research  on 
this  subject  suggests  that  "realism"  adds  many  attractive 
but  irrelevant  parts  to  an  instructional  presentation. 
Students  who  are  beginning  to  learn  a  new  subject  or  who 
have  difficulty  learning  seem  often  to  be  distracted  by  the 
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irrelevant  aspects  of  realistic  presentations.    The  most 
effective  instructional  presentations  for  new  or  slow 
learners  is  one  which  helps  focus  their  attention  and 
thinking  on  a  few  relevant  concepts  or  principles*    For  the 
more  advanced  student,  realism  seems  to  neither  help  nor 
hinder  learning. 


4)  Are  students  more  motivated  to  learn  from  newer  media 
such  as  video  disk  than  from  more  traditional  media? 

The  quickest  answer  to  this  question  is  an  enthusiastic 
—  yes*    The  motivation  encouraged  by  newer  instructional 
media  seems  to  be  common  in  a  great  variety  of  nations, 
cultures  and  different  types  of  individuals*    This  same 
enthusiasm  seems  also  to  be  shared  by  the  parents  of 
students*    This  enthusiasm,  I  believe,  accounts  for  some  of 
the  increased  learning  we  find  with  some  of  the  new  media* 
Yet,  even  here  there  are  two  exceptions:  1)  *«his  motivation 
seems  to  diminish  quickly;  and  2)  students  seem  often  to  be 
wrong  about  the  effort  it  will  take  to  learn  from  certain 
media* 

One  source  of  my  claim  that  student  interest  in  new 
media  diminishes  over  time  is  the  large  number  of  research 
studies  that  have  asked  this  question*    In  this  research  it 
is  generally  found  that  motivation  decreases  as  the  amount 
of  time  spent  with  a  new  medium  increases*    After  one  year 
with  televised  instruction,  for  example,  most  'Students  are 
only  as  enthusiastic  about  it  as  they  are  abou^  other 
alternatives*    This  same  result  is  true  of  computers  and  the 
new  video  disk  technology*    While  this  decrease  in 
motivation  may  be  partly  due  to  the  poor  quality  of  many 
instructional  4.iedia  presentations,  I  doubt  that  this  is  a 
significant  factor*    Generally,  familiarity  with  media  seems 
to  bring  acceptance  but  motivation  decreases  with 
familiarity* 

Much  of  the  reason  for  this  motivational  decrease,  I 
believe,  stems  from  inaccurate  student  beliefs  about  certain 
media*    Some  of  the  most  exciting  research  being  conducted 
at  the  moment,  explores  the  effects  of  student  expectations 
and  beliefs  about  media*    One  of  the  most  dramatic  early 
results  of  this  research  is  the  finding  that  students  think 
that  some  media  are  much  less  difficult  than  others*  For 
example,  students  seem  universally  and  wrongly  to  believe 
tnat  books  ar much  more  difficult  a  source  of  information 
than  is  television*    Their  belief  stems  from  the  fact  that 
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in  most  nations,  television  is  a  source  jf  light 
entertainment  and  current  events.    Books  seem  more  demanding 
by  virtue  of  their  traditional  content  for  the  student* 
Students  reason  that  television  makes  learning  easier  and 
more  entertaining.    This  is  the  initial  source  of  their 
increased  motivation  towards  it.    Yet,  a  moment's  reflection 
will  establish  that  there  is  nothing  about  the  written  word 
that  is  necessarily  more  demanding  than  television.    To  a 
psychologist,  it  appears  that  students  often  use  television 
in  a  "shallow"  way.    Whereas  they  are  taught  to  read  books 
they  are  not  taught  to  "watch"  television.    This  is  the 
origin  of  the  recent  interest  in  "media  literacy"  training 
in  a  number  of  nations.    We  need  to  give  more  instruction  to 
students  on  how  to  learn  from  new  media. 

The  obvious  problem  with  these  beliefs  is  that  many 
students  will  not  invest  enough  intellectual  effort  to  learn 
from  "easy"  media  sioh  as  television.    Less  obvious  is  the 
fact  that  students  seem  to  believe  that  computers  are  very 
difficult  learning  tools.    Some  students  seem  frightened  and 
think  that  the  new  medium  is  excessively  difficult. 
Literacy  training,  when  it  is  successful,  provides  students 
with  strategies  for  learning  from  new  media.  These 
strategies,  when  applied  over  time,  eventually  convince  the 
student  that  no  one  medium  is  any  more  difficult  or  more 
easy  than  iinother  for  learning.    It  is  the  content  of  the 
medium  that  imposes  difficulty  on  learning,  not  the  medium. 
This  may  be  why  motivation  for  new  media  decrease  over  time 
until  it  equals  motivation  for  more  traditional  media. 

5)  Do  media  such  as  video  disk  increase  the  freedom  of 
instruction-^1  choice  by  students? 

Nearly  all  psychologists  would  agree  that  different 
students  learn  best  from  different  instructional  strategies. 
This  fact  has  been  the  force  behind  our  interest  in 
"individualizing"  instruction,  particularly  at  the 
university  level  and  in  some  large,  urban  secondary  schools. 
On  the  simplest  level,  students  are  allowed  to  choose,  for 
example.,  whether  they  wish  to  attend  lectures  or  to  later 
listen  to  an  audiotape  of  the  lecture.    On  a  more 
sophisticated  level,  individualized  instruction  involves  the 
development  of  an  entire  course  of  study  through  specially 
designed  workbooks,  television  progr  ms  and/or  slide-tape 
presentations.    These  developed  courses  are  offered  as 
alternatives     ^  the  traditional  lecture  by  a  professor. 
Generally,  stu^^nts  like  to  have  choices.    In  American 
universities  approximately  half  of  the  students  offered 
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these  choices  elect  the  "individualized"  media.    It  is 
thought,  though  not  yet  established,  that  such  freedom  of 
choice  increases  student  motivation  to  learn  and  the 
intelligent  effort  they  will  spend  on  their  own  education. 

However,  there  is  a  problem  with  this  increased  freedom 
to  choose.    Research  by  psychologists  in  the  United  States 
has  established  that  some  students  seem  to  make  the  wrong 
choice  for  themselves.    The  most  capable  students  who  should 
choose  the  traditional  instructional  media  (which  is  often 
less  structured),  instead  choose  the  newer  media  (which  is 
often  more  directive  and  structured).    On  the  other  hand, 
less  capable  students  often  choose  the  traditional  lectures 
when  they  might  learn  more  from  the  structured,  newer  media 
and  teaching  strategies.    The  reason  for  these  less-than- 
perfect  choices  on  the  part  of  students  is  a 
misunderstanding  of  the  consequences  of  their  choice.  More 
capable  students  believe  that  the  more  structured 
instruction  will  make  their  study  more  efficient  and  give 
them  a  better  chance  on  their  examinations  with  less  effort 
expended.    Less  capable  students  seem  to  like  the  freedom  of 
the  less  structured  media  though  they  do  not  learn  as  much. 
In  some  cases,  they  have  the  freedom  not  to  expend  so  much 
effort  and  yet  receive  lower  evaluations.    So,  while 
alternative  media  do  provide  more  freedom  to  students  and 
while  they  like  this  freedom,  they  do  not  always  benefit 
from  it. 

Of  course,  it  is  possible  to  assign  students  to  these 
new  instructional  programs  which  use  the  newer  media.  One 
of  the  more  successful  and  dramatic  successes  of  this 
approach  is  the  Netherlands  where  one  of  the  medical  schools 
has  changed  its  curriculum  for  the  education  of  physicians 
to  an  individualized,  problem  solving  approach.    Instead  of 
the  traditional  lectures  and  reading  then  examinations,  this 
school  gives  students  carefully  planned  problems  to  solve. 
Evidence  in  that  nation  suggests  that  medical  students 
taught  by  this  new  plan  are  outperforming  traditional 
students  on  all  tests  —  even  though  they  are  randomly 
assigned  to  the  school. 
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6)  Are  video  disk  less  expensive  than  teachers  for  some 
types  of  instruction? 

The  final  question,  about  the  cost  of  media,  may  seem 
to  belong  more  to  the  study  of  economics  than  to  psychology. 
Yet,  assessing  cost  in  education  must  involve  the  relative 
learning  benefits  of  different  kinds  of  media.  Psychology 
investigates  learning  while  our  colleagues  in  economics  are 
concerned  with  theories  of  value  and  market,    xn  answering 
this  question  I  am  indebted  to  a  number  of  economist 
colleagues.    I  wi  1  briefly  present  some  of  the  conclusions 
of  the  economic  research  on  two  new  media,  television  and 
computers: 

There  is  good  evidence  that  televised  instruction  can 
be  made  very  inexpensive  if  its  use  is  spread  out  over  a 
great  number  of  students.    The  current  estimate  for  the  cost 
of  our  very  successful  children's  television  series.  Sesame 
Street,  is  about  $.50  US  per  viewing  child,  per  year. 
Considering  the  evidence  that  this  program  helps  our 
children  learn  to  read  faster,  the  cost  is  low.    This  may  be 
one  of  the  reasons  why  Sesame  Street  has  been  translated 
into  over  20  languages  and  has  been  acquired  for  broadcast 
in  many  nations.    Host  important  was  the  decision  of  the 
producers  of  this  program  to  develop  their  programs  using 
teams  of  teachers,  psychologists  and  artists.    Television  is 
increasingly  interesting  as  a  delivery  medium  for  education 
in  nations  where  economic  hardships  prevent  the  building  of 
adequate  classrooms  or  the  training  of  sufficient  numbers  of 
teachers. 

Recent  studies  show  that  computerized  instruction  is 
seldom  fully  utilized  in  any  school.    We  have  learned  that 
computers  and  other  media  take  a  great  deal  of  effort  to 
successfully  blend  with  other  school  activities.    If  fully 
used  however,  the  cost  of  computers  for  instruction  is  much 
less  than  most  of  us  had  expected  and  its  learning  benefits 
are  potentially  greater  if  adequate  instructional  programs 
are  used.    One  interesting  result  of  our  research  is  to  note 
that  the  cost  of  the  same  computerized  instructional  program 
may  change  a  great  deal  between  schools  and  between  nations. 
We  think  that  this  ^nay  be  due  to  the  way  in  which  schools 
implement  media  and  with  the  attitude  of  teachers.  There 
appear  to  be  some  management  and  organizational  plans  that 
are  more  efficient  and  effective  than  others  for  the 
production  and  use  of  new  media. 
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It  may  also  be  possible  that  video  disk  technology  will 
be  a  much  more  efficient  way  to  provide  interactive 
teaching*    At  the  moment  there  is  no  compelling  evidence  for 
or  against  the  claim  of  efficiency.    In  fact,  Henry  Levin  at 
Stanford  finds  that  for  most  purposes  requiring 
interactivity  in  teaching,  teachers  aids  paid  at  minimum 
wage  levels  were  much  more  cost-effective  than  computers. 
Why  should  we  not  find  the  same  thing  to  be  true  with  video 
disk  and  computer  marriages? 

Conclusion 

As  a  researcher,  I  remain  committed  to  the  use  of  media 
in  education.    When  combined  with  supportive  teachers, 
carefully  planned  lessons  and  a  sympathetic  educational 
system,  it  can  be  very  effective  and  inexpensive,    i  think 
that  it  is  very  unrealistic  (but  interesting  nonetheless)  to 
consider  what  an  educational  system  would  be  like  if  it  were 
primarily  delivered  by  newer  media.    Yet  I  am  most 
interested  in  the  possibilities  of  media  to  solve  some  of 
the  problems  of  developing  nations  and  the  children  of  the 
poor.    It  is  clear  that  we  have  not  yet  achieved  a  fair 
distribution  of  educational  benefits  in  the  third  world,  nor 
in  some  of  the  minority  groups  in  the  first  world.  These 
children  of  the  poor  require  high  quality  instruction  if 
they  are  to  take  their  rightful  place  in  their  own 
communities.    The  technology  of  education  which  has  been 
developing  these  past  two  decades  could,  if  properly 
implemented,  provide  one  critical  part  of  the  incentive 
these  children  need  to  obtain  an  education.    In  this  regard, 
I  am  impressed  with  the  progress  being  made  in  using  media 
by  nations  such  as  The  Peoples  Republic  of  China,  Indonesia, 
India  and  Mexico.    Many  of  the  problems  encountered  in  these 
new  media  programs  show  us  that  the  "transfer"  of  technology 
between  nations  is  a  difficult  task.    It  requires  a  great 
deal  of  communication  and  honesty.    For  those  of  use  who 
specialize  in  research  and  cheory,  it  requires  most  of  all  a 
wxllingness  to  let  our  rational  and  substantive  concerns 
about  learning  from  media  control  our  enthusiasms. 
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In  this  portion  ot  the  symposium,  i  would  like  to  present  some 
thoughts  on  why    e  continue  to  read  media  comparison  studies  when 
the  reasons  for  NOT  doing  this  type  of  research  have  been  widely 
documented  in  the  literature  for  many  decades.     I  felt  that 
facing  these  issues  from  this  perspective  may  shed  some  light  on 
how  to  stop  the  trend,  so  we  stop  wasting  more  effort  and 
opportunity  especially  where  interactive  video  is  concerned. 
Surely  only  by  understanding  the  problem  can  we  suggest  some 
alternative  approaches  to  studying  how  people  learn,  using  media 
or  more  specifically  computer  based  interactive  video,  as  a 
research  tool.     Hopefully,  with  this  understanding,  we  can  attempt 
to  eliminate  the  motivation  that  entices  us  to  continue  conducting 
this  type  of  research* 

So,  why  are  we  enticed  into  conducting  media  comparison  studies 
to  determine  the  relative  effectiveness  of  computer  based 
interactive  video  (CBIV)?    To  set  the  stage,  consider  three  very 
common  scenarios • 

First,  a  government  official  enters  your  office  and  wants  to  know 
all  about  interactive  video.     He/she  states,  "We  are  considering 
buying  interactive  video  for  training  health  care  providers. 
Tell  me,  is  interactive  video  effective?    For  what  types  of 
learning  is  it  effective?    is  it  better  than  stand-up  lecture  for 
teaching  procedures?    And  what  about  cost?    Is  it  cost-effective? 
Are  there  studies  which  can  unqualif iably  state  that  it  is 
ef  f<?ctive? 

Second,  you  read  an  article  of  some  well  designed  research  study 
in  which  the  researchers  use  CBIV  to  test  whether  X  instructional 
or  motivational  strategy  enhances  learning  and  find  significance. 
The  results  are  well  described,  but  in  the  introduction  and  the 
summary,  they  are  misrepresented;  the  researchers  state  that 
their  results  show  that  CBIV  is  effective! 

Or,  finally,  a  doctoral  student  enters  your  office  and  says  that 
his/her  administrator  wants  to  explore  the  effectiveness  of  CBIV. 
This  student  just  so  happens  to  have  a  pre-packaged  CBIV  lesson 
and  wonders  if  adding  this  lesson  will  affect  transfer  of 
learning.     She/he  proposes  a  simple,  quick  study  which  sets  up  a 
comparison  of  traditional  lecture  and  CBIV  with  an  extended 
traditional  lecture  to  "measure  the  ef f ecti veneiis  of  CBIV." 

In  Scenario  one,  the  "motivation"  is  a  plea  from  administrators 
for  data  to  help  them  make  informed  decisions  about  major  budget 
expenditures.    Compare  this  to  the  question,  "Are  flipcharts 
effective?"    Administrators  are  not  asking  this  type  of  question 
because  the  answer  is  not  as  critical  to  their  job  (and  job 
security).    Although  the  question  implies  it,  administrators 
really  are  not  concerned  with  whether  or  not  this  medium  wilJ  be 
effective  in  one  situation  versus  another.     In  other  words,  they 
are  not  concerned  with  making  micro  media  selection  decisions,  but 
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rather  with  making  macro  media  acquisition  decisions.  Media 
comparison  studies  offer  answers  to  micro  media  selection 
questions,  although  they  appear  to  offer  answers  to  the  macro 
questions.     Whereas  the  research  may  show  the  treatment  used  on 
CBIV  was  effective,  it  was  effective  for  one  specific  population, 
content  area,  and  instructional  strategy  used,  and  the  results  do 
not  offer  that  "guarantee"  that  administrators  v;ould  like  to  have. 

In  Scenario  two,  the  /motivation"  is  the  temptation  to  extend  the 
results  of  one's  study  to  provide  the  global  answers  to  those 
direct  questions  from  administrators  in  scenario  one.     The  need 
for  answers  to  the  media  question  is  very  great,  and  researchers 
who  use  media  appear  to  have  high  demand  results.    What  happens 
too  often,  unfortunately,  is  a  misrepresentation  of  one's  research 
results.     What  is  even  more  unfortunate  is  that  some  researchers 
are  not  even  aware  of  this  misrepresentation. 

In  Scenario  three,  the  "motivation"  is  the  ease  with  which 
studies  like  this  are  conceptualized,  conducted  and  analyzed. 
Deep,  concentrated  thinking  to  determine  the  true  factors  which 
are  having  an  effect  takes  a  great  deal  of  effort  and  time. 
Students  hear  advice  tc  first  just  get  a  study  done  to  meet  the 
degree  requirements,  and  then  go  out  and  do  something  significant 
and  important.     Although  I  am  realistic,  I  have  serious  concerns 
with  this  approach--the  main  problem  being  that  students  repeat 
what  they  know  and  have  practiced.     What  results  is  a  continuation 
of  loosely  conceptualized  research,  and  a  proliferation  of 
trivialized  media  comparison  studies. 

What  is  implicit  in  these  scenarios  is  that  administrators  need 
data  on  the  main  question,  "is  CBIV  effective?"  Simple-minded 
media  comparison  studies  (practiced  at  first  as  a  doctoral  study) 
seem  to  provide  them  with  easily  obtainable  data,  and  research 
which  uses  the  medium,  albeit  as  a  research  tool,  translates 
easily  into  a  response  to  that  question. 

For  scenario  one,     we  must  help  administrators  either  1)  rephrase 
their  question,  or  2)  appropriately  interpret  the  question  they 
are  asking.     If  we  eliminate  the  question,  then  we  will  also 
eliminate  the  temptation  to  extend  research  results 
inappropriately  to  address  the  effectiveness  of  a  medium  issue,  as 
we  so  often  see  as  noted  in  scenario  two.     While  we  may  never  be 
able  to  eliminate  the  third  scenario  by  making  research  easier  to 
do  (noL  would  we  necessarily  want  to),  we  must  take  the  leadership 
by  not  allowing  the  types  of  studies  noted  in  scenario  three  to  be 
practiced  by  doctoral  students. 

For  rephrasing  or  reinterpret  ing  the  question,  I  feel  that  there 
are  two  underlying  questions  which  are  integral  to  the  scenarios. 
"Is  interactive  video  effective?"  and,  more  importantly  is  CBIV 
cost-  effective?    Both  of  th(?se  questions  concern  me,  because  the 
first  implies  one  right  answer  to  a  very  global  question,  and  the 


126 


ERIC 


second  implies  a  comparison. 


For  the  cost  effectiveness  issue^  I  quite  heartily  agree  with 
Clark  that  we  need  to  conduct  more  studies  which  compare  media 
from  an  economic  standpoint.    This  seems  so  obvious r  that  it  makes 
me  wonder  why  there  are  not  more  researchers  focusing  their 
efforts  in  the  area  of  economic  analysis.     What  is  important, 
however,  with  this  approach  is  to  emphasize  to  adminstrators  that 
when  they  ask  the  question  about  CBIV  effectiveness,  they  really 
need  data  on  its  cost,  especially  where  these  more  expensive  media 
are  concerned.    The  effectiveness  issue  is  another  story  and  needs 
to  be  dealt  in  a  much  different  way  and,  therefore,  will  be  the 
focus  of  the  remaining  portion  of  this  paper. 

How  \jould  one  answer  such  a  question  as  "Is  CBIV  effective?"  that 
adrafriistrators  are  asking.      Given  the  arguments  laid  out  by  Clark 
and  others  (Clark,  1983,  1985,  Clark  and  Salomon,  1987,  Clark, 
1988,  Clark  and  Sugrue,  1988.)  in  the  last  few  decades,  my 
response  would  be,  "Of  course,  interactive  video  has  the  potential 
for  delivering  effective  instruction."     Implicit  in  this  response 
is  the  fact  that  interactive  video  can  also  deliver  very 
ineffective  instruction. 

To  identify  areas  for  research  on  learning  with  media,  we  should 
consider  what  factors  might  allow  or  prevent  the  medium  from 
reaching  its  potential  for  delivering  effective  instruction.  I 
divide  these  enabling  or  prohibitive  factors  into  2  categories: 
non-media  related  factors  and  media  related  factors. 

For  non-media  related  factors,  interactive  video  will  deliver 
effective  instruction  depending  on 

1)  the  appropriateness  or  inappropriateness  of  the  instructional 
and  motivational  strategies  used. 

2)  whether  or  not  the  medium  delivers  instruction  which  takes 
individual  differences  into  account.     Since  this  item  is  often 
subsumed  under  factor  one,  and  thereby  often  ignored  in 
research  and  design,  I  felt  that  it  warrants  a  separate 
listing . 

3)  the  appropriate  organization  of  symbol  systems  which  cultivate 
cognitive  skills,  or,  in  other  words,  appropriate  message 
design. 

For  media  related  factors,  two  factors  emerge.  Specifically, 
then,  interactive  video  may  deliver  effective  instruction 
depending  upon 

1)  whether  the  CBIV  medium  has  the  capability  to  carry  the 

selected  instructional,  motivation  and  message  design  strategy. 
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2)  whether  there  is  medium/individucl  belief  interaction. 


By  rephrasing  the  question  "Is  interactive  video  effective?**  to 
"Does  CBIV  have  the  potential  to  carry  effective  instruction?"  and 
by  considering  the  factors  that  may  prevent  the  medium  from 
delivering  effective  instruction,  I  feel  that  the  emphasis  is 
shifted  away  from  media  comparison  to  considering  the  question  in 
the  spirit  of  Clark's  argument*     This  shift  in  emphasis  denotes 
three  very  important  and  interrelated  areas  of  study. 

1.  "instructional  and  motivational  strategies"  research, 

2.  message  design  research,  and 

3.  Intra-medium  studies  (medium  specific  studies). 


The  essence  of  Clark's  argument  lies  in  the  first  of  these  three 
factors  in  that  it  is  the  instructional  design  that  makes  a 
difference  in  learning  rather  than  the  medium.     This  is  the 
clearest  and  most  well  documented  of  all  the  factors,  and  so  I 
won't  elaborate  on  this  issue  here  except  to  state  that  in  this 
area  CBIV  offers  tremendous  potential  for  functioning  as  a 
research  tool  because  of  its  data  collection  capability,  its 
standardization  of  treatments,  and  automatic  randomization 
capabilities. 

If  instructional,  motivational  and  message  design  strategies  are 
the  main  determining  factors  of  a  lesson's  effectiveness,  then  the 
next  step  it  seems  is  to  study  the  medium's  attributes  and  symbol 
systems  to  determine  its  ability  to  actually  relay  these 
designated  strategies.     Selecting  a  medium  which  cannot  deliver 
the  design  strategies  is  like  asking  a  non  singer  like  myself  to 
sing  a  song,  or  trying  to  carry  a  couch  in  a  Volkswagen  Beetle,  In 
both  cases  the  "message"  gets  carried,  but  the  quality  of  the 
received  message  has  been  impaired  by  the  "medium's"  capability  no 
matter  how  solid  the  design.     In  other  words,  by  understanding  the 
medium's  capability  to  deliver  the  specified  instructional, 
motivational,  and  message  design  strategies,  we  won't  be  asking  a 
non-singer  to  sing,  or  having  a  small  car  deliver  too  large  of 
packages.     What  is  implied  here  is  to  study  the  capabilities  of 
the  medium  NOT  to  determine  its  effectiveness  one  over  the  other 
but  rather  to  determine  which  of  the  design  strategies  it  can 
carry.     The  purpose  of  this  study  «?ould  be  to  create  a  matrix 
which  matches  design  strategies  with  specific  media  attributes  and 
symbol  systems.     We  know  a  great,  deal  about  the  media  that  have 
been  around  for  decades,  but  I  don't  feel  that  we  fully  understand 
the  capabilities  and  symbol  systems  of  the  newer  technologies  as 
to  their  ability  to  carry  some  of  the  newer  instructional 
strategies  being  suggested  by  the  shift  in  emphasis  to  a  cognitive 
versus  a  behavioral  approach  to  learning. 
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One  potential  outcome  is  the  identification  of  clusters  of  media 
attributes  that  cultivate  cognitive  skills.     Clark  in  his  1987 
address  to  AECT,  acknowledged  the  potential  of  this  approach,  but 
remained  skeptical  because  of  the  trend  of  this  research  is  to 
find  the  "one"  right  media  attribute  that  would  indeed  cultivate 
cognitive  processes.     Again,  I  am  not  suggesting  that  one 
attribute  may  be  better  fr<xn  a  comparison  point  of  view,  but 
rather  that  it  is  important  to  identify  which  ones  may  have  that 
capability.    The  most  prevalent  medium  which  may  possess  those 
unique  attributes  is  the  computer  because  of  its  ability  to 
emulate  human  cognitive  processing  (Kozma,  1987).    Exploring  the 
medium's  potential  actributes  in  light  of  the  current  thinking  and 
research  on  generative  strategies  and  adaptive  instruction  leaves 
me  yet  unconvinced  that  all  media  attributes  can  facilitate  all 
types  information  processing  by  all  types  of  learners. 

An  excellent  example  of  this  type  of  research  is  suggested  by 
Kozma  (1986,  1987)  of  Michigan  in  two  reports — one  on  computers 
and  one  on  video.     He  contends  that  the  computer's  ability  to 
emulate  human  cognitive  processing  may  supplant  lacking  cognitive 
strategies  and  in  turn  reduce  the  load  on  short  term  memory/ 
working  memory  and  thereby  increase  learning.     Studying  CBIV  as  a 
medium  to  deliver  instruction  may  contribute  to  our  knowledge  on 
how  individual's  process  information  and  vice  versa.  This 
signifies  to  me  an  iterative,  interactive  and  synergistic  process. 
If  we  didn't  study  the  attributes  perhaps  the  means  for  delivering 
various  strategies  may  be  left  undiscovered.    Again,  I  find  this 
especially  true  as  we  rethink  the  use  of  generative  strategies. 

The  second  media  related  factor  is  a  medium/individual  belief 
interaction.    While  I  would  agree  with  Clark  that  the  individual 
holds  the  belief,  those  belief  systems  are  caused  by  some  external 
event.     This  factor  is  especially  important  with  the  increased  use 
of  computers  and  the  phenomenon  of  computer  phobia.     The  best 
design  ever  delivered  via  a  computer  will  not  communicate  its 
message  to  someone  who  sits  in  fear  of  it  or  who  has  a  disdain  for 
the  impersonal  nature  of  the  medium.    Clark  does  not  deny  that 
this  phobia  exists,  he  has  just  identified  the  problem  as  being 
within  the  individual  rather  than  being  the  medium  than  makes  a 
difference.    My  suggestion  as  to  how  to  view  this  factor  is  as  an 
interaction  between  the  individual  and  the  medium — with  both 
contributing  to  the  resulting  ineffective  instruction.  This 
implies  identifying  the  factors  both  about  the  individual  and  the 
medium  that  may  cause  such  a  reaction.     By  learning  about  one,  we 
can  contribute  to  our  knowledge  about  the  other. 

To  conclude,  by  studying  the  interaction  of  strategies/media 
attributes  of  CBIV/individual  beliefs,  we  may  better  be  able  to 
respond  to  the  administrators  in  Scenario  one  by  stating  "CBIV  has 
the  potential  for  delivering  effective,  motivating  instruction 
because  it  can  deliver  these  types  of  instructional  strategies 
which  have  been  shown  to  be  effective  for  these  types  of  learners. 
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I  basically  agree  with  what  Richard  Clark  has  said  today,  and  just 
as  he  has  emphasized  expectation  and  beliefs  in  relation  to 
motivation,  I  am  going  to  present  my  expectations  and  beliefs 
about  motivation  and  what  is  motivating.     My  own  beliefs  are  that 
Dr.  Clark's  discussions  of  the  importance  of  knowing  about 
cognitive  and  design  issues  are  actually  discussions  about 
motivation. 


For   le,  learner  motivation,  with  its  myriad  of  subconcepts, 
includes  all  issues  relevant  to  learning  and  instruction.     It  is 
the  pi^ital  factor  in  education,  no  matter  what  medium  is  employed 
or  how  it  is  used.     I  would,  however,  add  that  there  may  be  some 
media  which  do  make  specific  contributions  in  some  situations  in 
efficiently  and  effectively  influencing  learner  motivation  in  a 
positive  manner--some  more  than  others  in  comparison,  both  in 
reality  and  in  promise.     In  other  words,  motivation  is  key,  but 
the  medium  may  influence  that  motivation. 

If,  as  defined,  motivation  includes  all  factors  which  arouse, 
sustain,  and  direct  behavior  (Keller,  1978),  then  we  can  say  that 
the  study  of  the  construct  of  motivation  is  the  study  of  all  of 
the  antecedents,  all  of  the  processes,  and  all  of  the  consequences 
of  learning  which  link  all  of  the  individual's  feelings,  thoughts, 
and  actions  in  learning.    The  beliefs  and  expectations  which 
Richard  Clark  noted  in  his  presentation  represents  only  a  small 
subset  of  the  total  motivational  states  of  the  learner.     All  of 
this  implies  that  in  our  research,  we  mus    look  at  the 
motivational  state  of  the  learner  in  interaction  with  the 
instructional  method  (Clark,  R.  C.  and  Clark,  R.  E. ,  1984).  I 
regard  this  question  of  interaction  as  valid  and  important,  and  I 
would  place  special  emphasis  on  the  value  of  finding  the  answers 
for  our  attempts  at  inducing  learning. 

Indeed,  Clark  and  his  colleagues  h -^ve  identified  many  issues  which 
I  categorize  as  motivational  facto  s  that  go  beyond  what  he  has 
included  in  b'        atement  in  today's  presentation.     For  example, 
they  have  co^  d  the  novelty  effect  of  certain  media  methods 

(Clark,  19P  ^  role  of  learner  stress,  anxiety,  and  worry  in 

learning  ( Fr  &  Clark,  1985),  the  presentation  of  feedback  in 

terms  of  the  ow-lf-ef f icacy  theory  (Vlau  &  Clark,  1987),  and  the 
orientation  of  the  novice  versus  the  expert  learner  in  terms  of 
attitudes,  experiences,  and  aptitudes  as  they  relate  to  design 
issues  of  task  difficulty,  attention  focusing,  choice,  and  to 
instructional  delivery  methods  (Aster  &  Clark,  1985,  McGowan  & 
Clark,  1985).     In  addressing  these  issues,  they  are  investigating 
the  interaction  of  design  and  delivery  methods  with  personality 
and  experience. 

After  many  years  of  examining  motives  and  motivation  and  what  they 
mean  i^  psychology  and  learning,  my  own  particular  bias  is  to  find 
out  wh  >  ;  motivates  individual  students  to  learn  and  to  determine 
how  to  enhance  and  develop  this  motivation.     My  efforts  are 
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directed  toward  investigating  three  general  goals  for  learning. 
The  first  goal  is  motivating  the  learner  to  attend  and  participate 
in  the  learning  activity;     the  second  is  motivating  the  learner  to 
achieve  both  the  designated  learning  outcomes  and  positiC^ 
attitudes  toward  the  content  and  process;     and  the  third  goal  is 
continuing  motivation,  or  helping  the  learner  apply  the  learning 
in  present  and  future  situations.    After  surveying  the  genera^ 
motivational  issues — which  I  feel  include  every  factor  involved  in 
learning — I  conclude  that,  in  order  for  a  designer  to  fully 
accomplish  these  three  goals,  it  is  essential  that  we  have  a 
thorough  understanding  of  the  learner's  personality  as  well  as 
his/her  feelings  and  cognitions  about  him/herself,  others,  the 
medium,  the  task  and  the  demands  of  the  task.     Only  by  having  this 
understanding  can  we  deliberately  plan,  design,  implement  and 
adapt  a  motivational  delivery  program  for  every  lesson  which 
accomplishes  or  at  least  encourages  the  attainment  of  the  three 
goals  I  have  m^ntioned.     This  suggestion  holds  true  for  any  and 
all  instructional  media  and  methods  applied. 

The  first  point  I  wish  to  make,  then,  is  not  so  much  one  of 
designating  which  instructional  medium  may  be  the  most  motivating 
by  comparing  one  to  another  and  asking  "why,"  but  one  of  deciding 
what  the  motivational  issues  are,  for  whom,  when,  and  whether  or 
not  they  are  truly  being  addressed  by  designers  in  an  other  than 
haphazard  way.  Do  we  actually  see  al 1  aspects  of  learning  in  terms 
of  motivation?    Dc  we  actually  take  every  factor  into  account, 
assess  and  know  the  individual  learner  in  regard  to  the  factors, 
and  do  we,  in  reality  design  lessons,  for  any  medium,  which  then 
cultivate  motivation  and  encourage  learning?    Or  do  we  simply 
depend  upon  the  content  to  have  an  inspiring  effect  on  some 
learners,  or  on  the  learner's  own  efforts  to  make  the  tasks 
enjoyable  for  themselves?    Further  still,  are  designers  relying 
on  certain  media  such  as  CBI  and  video  to  offer  that  novelty 
effect  mentioned  by  Clark  and  to  therefore  "be  motivating"? 
Because  of  what  designers  may  or  may  not  do,  the  question  for 
researchers  becomes  not  one  of  comparing  the  motivational  value  of 
differing  media,  but  how  much  do  we  know  about  the  person  and 
instruction,  the  interaction  between  the  two,  how  can  we  learn 
more,  and  how  will  we  deliberately  encourage  the  use  this 
information  in  design  and  delivery. 

My  second  point  is,  given  that  a  motivational  delivery  program  can 
be  planned,  designed,  implemented  and  adapted  around  each  content 
and  learner,  how  can  it  best  be  implemented  on  each  medium  to 
determine  if  there  are  certain  media  which  could  deliver  this 
program  more  effectively  and  efficiently  than  others? 

Throughout  my  discussion,  I  have  been  agreeing  with  Dr.  Clark  when 
he  says  that  the  learner's  beliefs  and  expectations  are  important 
in  their  approach  to  a  medium,  as  is  the  study  of  the  interaction 
between  the  student's  motivational  state  and  the  instruction.  I 
have,  however,  expanded  Lhe  imporcance  of  the  construct  of 


134 

139 


motivation^  which  includes  a  comprehensive  set  of  all  learning 
factors^  that  motiva*-ion  can  be  learned^  and  that  we  should 
deliberately  design  foi  the  enhancement  of  positive  motivational 
task  accomplishment  and  attitudes  for  each  student.  Certain 
factors  already  seem  clear  from  the  research  on  what  contributes 
to  positive  motivation.     These  are:    Clear  and  realistic  goal 
setting;    clear  task  boundaries;  choice;  incremental  task 
accomplishment;     responsive  leadership  and  active  learner 
participation;  energetic^  enthusiastic  presentation;  a 
knowledgeable  and  approachable  teacher;  the  setting  of  positive 
expectancies  for  success;  a  climate  of  trust,  openness  and 
acceptance;  moderate  novelty  and    surprise;  needs  assessed  and 
met;  acceptance  of  failure  and  encouragement  of  risk-taking;  and 
properly  executed  reinforcement  and  reward.     In  our  quest  to 
delineate  what  will  succeed  with  what  learner,  we  should  not 
overlcok  the  idea  that  there  may  be  media  which  have  more 
potential  than  others  for  delivering  strategies  directed  at 
accomplishing  a  true  and  positive  learning  experience  which 
incorporates  those  factors  listed  above.      There  may  be  some  media 
which  can  more  fully  deliver  "motivational  designs."     In  theory, 
this  should  not  be  necessarily  so^  but  in  practice,  it  is  worth 
thinking  about. 

If,  as  Clark  suggests,  lesson',  are  more  carefully  designed  for 
technical  media,  then  maybe  ve  should  begin  to  design  deliberate 
motivational  elements  for  su":h  pedia.     For  example,  it  has  been 
documented  that  consistency,  relevancy  and  reward  are  important  in 
directing  motivational  learning.     This  can  be  well  accomplished  in 
design  for  education  via  various  madia.     If,  also,  adaptation  to 
the  individual's  motivational  state  is  considered      ^  ^rtant  in 
learning,  then  a  computer  m.*y  best  be  able  to  ir  assessment 
devices  and  constant  monitoring  of  changes  needed  to  keep  the 
student  interested  ^nd  engaged.     While  teachers  generally  hope  to 
motivate  students,  and  understand  motivation,  they  seldom  have  the 
time  to  adjust  learning  for  each  person  they  instruct.     I  suggest, 
in  addition  that  ^machines"  may  be  "best'  at  helping  teachers  to 
enhance  motivation.     Teachers  themselves  will  have  more  time  to 
know  the  individual  learner  in  terms  o^  their  wants  and  needs  when 
they  are  freed  from  some  of  the  obligations  of  delivering  all  of 
the  content. 

Although  I  do  not  wish  to  be  comparing  media  with  regard  to  these 
issues,  I  do  wish  to  say  that  CBIV,  in  particular,  is  a  medium 
which  has  outstanding  potential  for  delivering  programs  which  have 
been  mot i vationally  designed.     CBIV  offers  a  cluster  of  attributes 
which  may  effectively  combine  instruction  with  motivational 
elements  to  encourage  learning.     It  is  a  responsive  and 
participative  medium  whereby  the  motivational  design  elements  can 
be  consistently  and  fairly  applied,  choices  offered,  databases  for 
a  richness  of  relevant  examples  and  practice  quickly  accessed,  and 
learner  needs  recorded,  monitored  and  adapted.     CBIV  is  a 
multi-sensory  approach  to  learning  which  may  vividly  portray  "the 
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human  qualities"  of  the  enthusiastic,  caring,  knowledgeable 
teacher.     Thus,  with  CBIV,  the  designer  has  an  outstanding 
opportunity  to  incorporate  the  strategies  which  encompass  those 
factors  which  researchers  have  identified  as  contributing  to  a 
positive  motivational  state  for  the  learner. 

It  would  be  my  hope  that  this  medium,  in  particular,  be  explored 
as  to  how  it  can  display  material  which  enhances  learner 
motivation.     Equally  important,  to  me,  is  the  research  on 
learning —  on  the  interaction  of  the  student's  motivational  state 
and  the  instruction — which  can  be  conducted  using  the  potential  of 
CBIV  as  a  re*»earch  tool.     By  using  this  medium  in  this  way,  and  by 
not  focusing  on  comparing  this  medium  to  others,  we  may  discover 
more  about  what  works  for  whom,  and  when  and  create  strategies 
that  motivate  students  to  learn  and  care  about  that  learning, 
strategies  which  can  transfer  to  other  media  as  well  as  enrich  our 
capabilities  to  educate. 
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The  Singer  or  the  Song 


A  COMMON  SENSE  APPROACH 

This  presentation  is  offered  as  an  extension  of  Richard  Clark's 
position  regarding  media.  Through  this  paper,  I  hope  to  translate 
Clark's  argument  into  practical  terms,  and  point  out  some 
different  issues  that  have  not  yet  been  resolved. 

Clark  has  been  the  strongest  advocate  of  a  particular  point  of  view 
regarding  media--that  media  make  no  difference  in  student 
achievement.  In  other  words,  the  medium  itself  is  not  a  significant 
contributor  to  achieving  the  ends  of  learning,  but  rather 
instructional  strategies-the  particular  ways  that  instruction  is 
assembled  and  the  components  thereo^--are  the  true  independent 
variables  in  a  learning  situation.  Clark    as  stated  that  media  arc 
"mere  vehicles"  that  can  be  used  for  the  delivery  of  instruction-- 
but  are  not  required  for  learning. 

Clark  has  cited  numerous  research  studies  that  have  failed  to 
contt-ol  for  the  effects  of  instructional  strategies.  Essentially  these 
studies  have  compared  educational  "apples  with  oranges,"  and 
conscquentiy  these  studies  are  suspect  to  a  confounding  effect, 
that  is,  the  notion  that  there  could  be  other,  equally  rational 
reasons  for  any  given  difference  in  achievement.  Clark  claims  that 
previous  media  comparison  studies,  which  tend  to  turn  up  with 
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the  emergence  of  any  new  media/technology,  all  fail  to  control  for 
the  effect  of  instructional  strategies  within  different  treatment 
groups. 

Obviously,  then,  these  "media  comparison"  studies  that  ClarL  cites, 
are  really  not  studies  that  are  designed  to  compare  the  effects  of 
media  in  instruction.  Since  they  use  different  designs, 
instructional  components  and  sometimes  different  symbol 
systems,  they  are  essentially  studies  that  compared  the  effects  of 
different  mediated  instructional  designs-hut  not  different  media. 

From  a  "pure"  research  perspective,  it  would  seem  that  Clark  is 
correct  in  his  conclusions.  Adding  Salomon's  notion  of  symbol 
systems-the  various  ways  that  information  is  encoded-would 
suggest  that  if  we  controlled  for  different  symbol  systems  along 
with  different  instructional  strategies,  then  we  might  seemingly 
have  a  media  comparison  study  that  would  be  valid.  Comparing 
the  aniount  of  cognitive  learning  when  identical  instructional 
strategies  and  symbol  systems  are  used  should  logically  produce 
no  difference  in  achievement.  What  mighi  such  a  study  look  like? 
For  example,  one  group  could  be  given  several  paragraphs  on 
paper  to  read,  while  a  second  group  is  given  exactly  the  same 
material,  except  the  second  group  has  the  material  projected  on  a 
wall  using  a  slide  projector.  An  achievement  test  would  probably 
show  no  difference  between  the  groups--in  other  words,  the 
medium  would  have  made  no  difference  in  such  a  learning 
situation.  Now,  perhaps  changing  the  symbol  system  would  make 
a  difference.  For  example,  if  one  group  read  the  paragraph  while  a 
second  group  heard  an  audio  tape  of  the  information.  Of  course,  if 
a  difference  in  achievement  occurred,  it  could  be  due  to  the 
different  symbol  systems  that  were  used,  not  necessarily  the 
medium  that  carried  either  symbol  system.  While  this  logical  type 
of  "thought  experiment"  really  doesn't  confirm  Clark's  conclusions, 
it  brings  home  the  common  sense  side  of  his  position.  Indeed,  in 
such  an  experimental  situation  where  both  symbol  systems  and 
instructional  strategies  are  held  constant,  it  would  be  remarkable 
if  there  was  a  significant  difference  in  achievement. 

My  goal  today  is  to  agree  in  principle  with  Clark's  position,  but  to 
extend  it  to  consider  alternative  ways  of  thinking  about  media 
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regarding  the  difference  media  do  make  along  with  the  difference 
that  they  can  make. 

I  would  like  to  take  a  somewhat  logical  look  at  two  major  areas. 
These  areas  are  the  differences  between  cognitive  and  affective 
learning  outcomes,  and  the  differences  between  common  usage 
and  potential  of  a  medium. 


COGNITIVE  AND  AFFECITVE  OUTCOMES 

Clark's  famous  and  often  quoted  analogy  equates  media  and 
instruction  with  food  and  the  truck  used  to  deliver  the  food:  the 
medium  that  delivers  instruction  will  have  no  more  of  an  impact 
on  student  achievement  than  the  truck  that  delivers  food  will 
have  on  the  nutritional  value  of  that  food.  In  other  words,  media 
are  "mere  vehicles"  for  the  delivery  of  instruction. 

I  would  like  to  offer  a  different  analogy  that  might  lead  to  a 
different  conclusion:  the  singer  and  the  song.  That  is,  at  times  the 
medium  is  as  important  as  the  message-and  at  times  more  so. 

Music  business  people  generally  agree  that  the  best  way  to  sell 
records  is  not  through  massive  airplay,  but  rather  "putting  the 
artist  on  the  road."  People  tend  to  like  musicians  that  they  have 
seen  perform  live  .  This  explains  why  musicians  still  tour  despite 
the  sophisticated  mass  communication  technology  currently 
available.  Now,  it  is  interesting  that  a  member  of  the  audience  can 
like  a  performer  but  be  unable  to  restate  any  of  the  lyrics  to  any 
songs.  Hence,  the  audience  may  not  be  perceiving  any  cognitive 
message  at  all.  But  through  real  "contact"  with  the  artist,  a  change 
in  attitude  or  belief  occurs.   This  points  to  the  real  key  to  this 
analogy-there  are  definite  affective  and  cognitive  differences 
between  mediated  music  and  live  music.  And  there  are 
differences  between  mediated  instruction  and  live  instruction. 

A  song  is  really  "content"  delivered  by  a  singer,  the  same  way  that 
instruction  is  delivered  by  a  medium.  Is  there  a  difference 
between  Frank  Sinatra  and  Frank  Schwartz?  That  probably 
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depends  on  if  you're  a  Sinatra  fan  or  not;  if  so,  then  there  is  a 
major  difference  in  "mere"  delivery  vehicle! 

A /an  would  be  happy  to  heai  Sinatra  sing  anything-so  a  fan  will 
attend  to  any  content  that  is  presented,  simply  through  his  affect 
toward  the  vehicle  (Sinatra).  To  others,  it  may  be  the  song  that  is 
important.  "My  Way"  might  be  a  song  that  interests  them-and 
they  may  be  totally  oblivious  to  the  performer. 

If  this  analogy  holds  true  for  instruction,  then  we  might  conclude 
that  certain  media  can  evoke  attention  simply  because  of  a 
student's  continuing  and  previously  learned  affect  for  a  medium. 
Was  there  a  difference  in  your  own  attending  behavior  when  Dr. 
Clark  was  not  here  in  person  today?  While  you  have  been  exposed 
to  the  same  symbol  system  of  spoken  language,  some  people's 
attention  may  have  wandered  because  the  real  Richard  Clark 
wasn't  here.  You  wanted  Sinatra-you  got  Schwartz. 

Clark  speaks  of  this  effect  in  terms  of  attribution  theory  and 
claims  that  attitude  toward  medium  is  not  a  media  attribute,  but 
rather  a  learner  attribute.  My  thoughts  on  this  say  that  if  using  a 
different  medium  will  produce  greater  attention,  then  this  is 
indeed  correlated  with  the  medium,  and  should  be  considered  a 
media  attribute. 

Of  course  the  flip  side  may  also  be  tnie-a  strong  negative  affect 
for  any  medium  may  destroy  motivation  and  interest.  How  many 
people  tend  to  groan  when  a  teacher  or  trainer  pulls  out  a  stack  of 
transparencies  and  approaches  the  overhead  projector?  How 
many  people  have  a  fear  of  innovation  and  would  rather  not 
approach  CBT  or  Interactive  Video  because  of  their  fear  of  the 
medium  itself?  In  like  manner,  no  matter  how  great  a  voice 
Mohmar  Khadaffi  has,  not  many  Americans  want  to  hear  him  sing 
"Strangers  in  the  Night."  So  the  delivery  vehicle  can  interact  in  a 
distracting  emotional  way  to  affect  cognitive  learning. 

A  recent  study  was  interested  in  the  effect  of  a  program  to  help 
shy  women  start  and  maintain  conversations  with  men.  The 
delivery  vehicles  were  both  CBT  treatments  and  text-based 
treatments.  Although  the  women  learned  slightly  more  from  the 
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text-based  treatments,  there  was  no  significant  difference 
between  the  two.  While  this  study  points  to  Clark's  "no  difference** 
conclusion,  it  didnt  explore  the  possible  differences  between  live 
instruction  and  any  form  of  mediated  instruction.  It  would  be  a 
logical  hypothesis  that  a  n'ale,  human  instructor  might 
significantly  change  the  achievement  levels  of  the  learners,  either 
for  better  or  for  worse. 

Clark  has  identified  a  positive  affect  toward  innovation  as  a 
"novelty  effect,"  a  tendency  for  students  to  work  harder  and 
achieve  more  when  a  new  novel  medium  is  used.  The  novelty 
effect  tapers  off  after  a  few  months,  once  students  become 
accustomed  to  the  new  medium.  Although  I  don*t  debate  the 
existence  of  this  effect,  it  is  probable  that  with  at  least  some 
students,  a  semi-permanent  preference  for  one  medium  over 
another  might  occur.  This  seems  no  more  unreasonable  that 
preferring  one  singer  over  another*  or  one  brand  of  toothpaste 
over  the  next.  Another  interesting  point  is  that  this  preference 
may  have  little  to  do  with  the  actual  effectiveness  of  the  product 

Thus  far  I  have  been  making  a  case  based  on  logic  and 
assumptions  that  from  a  cognitive  point  of  view,  there  may  be  no 
difference  in  learning  achievement  but  from  an  affective  view,  for 
any  individual,  there  could  be  large  differences  in  attitude  and 
motivation  that  might  interfere  with  learning  of  cognitive  tasks. 
Through  the  laws  of  contiguity  and  association,  wc  know  that 
affect-positive  or  negative-gets  paired  with  content.  So  not  only 
might  media  alter  one*s  motivation  toward  learning,  and  one's 
willingness  to  attend  to  a  message,  but  medium  may  be  adding  a 
subliminal  message  to  the  content  which  actually  changes  the 
content. 

What  kind  of  statement  is  made  if,  for  example,  the  president  of  a 
major  international  company  gives  his  state-of-the-business 
address  using  hand  drawn  transparencies?  Or  worse,  he  writes  on 
a  blackboard.  Might  that  give  you  a  subliminal  message  that  the 
company  is  doing  poorly?  Suppose  he  gave  the  same  speech 
accompanied  by  3Smm  film  or  high  quality  slides.  Might  you  then 
think  that  the  cow.pany  was  doing  at  least  okay?  Although  the 
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same  symbol  systems  (written  words)  might  be  used,  the  overall 
message  that  a  viewer  receives  is  entirely  different. 

There  are  other  activities  and  situations  that  just  don't  translate 
well  to  media-no  matter  how  identical  the  symbol  systems. 
McLuhan  said  in  Understanding  Meriia  "It  is  a  truism  among  jazz 
performers  that  recorded  jazz  is  as  stale  as  yesterday's 
newspaper.  Jazz  is  alive,  like  conversation..."  As  such,  part  of  the 
enjoyment  of  jazz  is  the  knowledge  that  it  is  spontaneous  and 
being  created  on  the  spot,  and  you  are  privileged  to  be  in  the 
company  of  this  "conversation"  and  creation.  Sporting  events  are 
also  an  event  where  being  there  is  half  of  the  "learned" 
knowledge.  You  can  watch  the  game  on  tv  or  read  the  box  score 
for  the  cognitive  parts  of  the  game;  the  emotional,  affective 
experience  comes  mainly  from  "being  there."  I  once  toured  the 
house  in  Amsterdam  where  Anne  Frank  hid  from  the  Nazis  during 
World  War  II.  Although  I  could  probably  sec  films  of  this  house, 
and  someone  might  even  construct  a  simulated  version  of  the 
house,  it  is  not  the  same  emotional  experience  as  actually  walking 
through  the  real  environment.  I'm  not  sure  that  this  translates 
into  a  typical  procedural  training  situation-but  it  does  strongly 
suggest  that  in  teaching  affective  content,  media  and  reality 
factors  make  a  definite  difference  and  must  be  considered. 

This  is  not  to  imply  that  media  cannot  move  an  audience;  it  is 
clear  from  the  success  of  Hollywood  all  these  years  that  media  is 
indeed  a  powerful  emotional  medium.  But,  following  the  terms  in 
this  argument,  films  must  use  different  symbol  systems  to 
produce  the  same  emotional  end.  No  doubt  that  a  film  of  Anne 
Frank's  house  could  move  me,  too--but  it  might  take  tie  addition 
of  music,  close-ups,  different  angles,  and  perhaps  a  sto»/  line  to 
accomplish  what  a  few  moments  of  "reality"  could  induce.  I'll 
come  back  to  this  point  of  different  ways  to  evoke  and  cultivate 
cognitions,  later  in  the  paper. 


COMMON  USAGE  AND  POTENTIAL 

Let's  return  to  the  research  conclusion  that  if  we  hold  all 
instructional  strategies  and  symbol  systems  constant,  then  there 
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will  be  no  difference  in  cognitive  learning  regardless  of  the 
medium.  Recall  my  earlier  example  of  two  experimental  groups, 
one  group  reading  a  page  of  text  and  the  other  group  reading  that 
same  text  projected  on  a  wall,  and  my  conclusion  that  there  would 
not  be  a  difference  in  cognitive  learning  under  these  conditions. 
When  I  have  mentioned  such  a  study  to  "media  people"  the 
typical  comment  is  that  research  of  this  type  exploits  totally 
inappropriate  uses  of  the  various  media.  That,  in  fact,  no  media 
producer  would  ever  recommend  that,  for  example,  hundreds  of 
pages  of  text  be  delivered  via  overheads  or  slides.  The  most 
appropriate  way  to  deliver  such  content  would,  of  course,  be 
through  books  or  other  text  based  media.  So  while  Clark's  position 
is  probably  irue  in  an  experimental  design  research  situation, 
where  all  variables  could  possibly  be  controlled  for,  in  reality  no 
one  should  ever  use  media  in  such  inappropriate  ways. 

So,  the  question  now  is  turning  from  does  media  make  a 
difference  to  can  media  make  a  difference. 

Each  medium  is  a  combination  of  attributes  capable  of  carrying 
various  combinations  of  different  symbol  systems.  To  the  extent 
that  media  carry  identical  symbol  systems  relating  to  "critical" 
content  (Salomon's  term),  then  each  medium  should  be 
interchangeable. 

However,  in  a  pragmatic  sense,  some  media  are  capable  of  doing 
more.  They  have  more  attributes,  or  they  can  support  more 
instructional  strategies,  such  as  allowing  student  input, 
personalized  feedback,  etc.  Each  medium,  then  may  only  be  able 
to  support  specific  instructional  designs.  For  example,  a  mcie 
complex  and  versatile  medium  such  as  interactive  video  has  the 
potential  for  serving  and  delivering  many  more  instructional 
designs  than  a  less  sophisticated  medium,  for  example  a  flip  chart. 
What  is  interesting  here  is  that  Clark  concludes  that  there  are  any 
number  of  ways  to  cultivate  mental  processing-and  that  there  is 
not  a  one  to  one  correspondence  with  any  media  attribute  and  a 
type  of  learning.  He  uses  the  terms  "sufficient  conditions"  as 
opposed  to  "necessary  conditions."  Sufficient  conditions  can  evoke 
certain  learning,  but  are  not  necessary  conditions,  since  any 
number  of  media  attributes  can  evoke  the  same  learning.  This 
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would  make  one  assume  that  many  different  designs  and 
ipproacheu  c.n  achieve  the  same  learning  end. 

However,  Salomon,  in  1978,  said,  "When  critical  information  is 
coded  differently  in  different  media,  learning  outcomes  cannot  be 
the  same  because  different  mental  operations  are  employed."  So,  I 
conclude  that  only  to  the  extent  that  similar  mental  operations  can 
be  stimulated,  are  media  interchangeable. 

To  tie  this  back  to  the  reality  versus  media  topic  I  previously 
mentioned,  it  may  be        certain  "live"  events  stimulate  certain 
mental  processes  for  a        rent  type  of  learning.  The  awareness 
that  an  event  is  a  rca!  and  unique  experience  may  force  different 
cognitive  operations  to  occur;  this  may  then  foster  differenf 
cognitive  skills  and  learning  outcomes. 

The  conclusion  that  media  are  interchangeable  to  the  extent  that 
they  stimulate  the  same  cognitive  operations  and  skills  is  a 
powerful  conclusion,  and  hints  at  some  future  directions  for 
research.  Adopting  this  perspective  would  hint  that,  along  with 
media  comparison  research,  even  Media  attribute  research  is 
niisleading-that  we  should  be  studying  cognitive  constructs  that 
directly  influence  learning.  This  has  been  tried  with  m'xed  success 
with  ATI  research.  However,  it  might  be  that  the  wrong  constructs 
have  been  isolated.  Aristotle  said,  "Break  nature  apart  at  her 
joints."  It  may  be  that  some  of  our  individual  difference  aptitudes 
have  not  been  is  'ated  in  ways  that  maximize  their  pr  xtive 
abilities,  because  they  have  been  empirically  conceived  instead  of 
theoretically  derived,  resulting  in  a  shotgun  approach  (Jonassen, 


I  think  that  neurological  theories  of  how  the  brain  functions 
promise  an  immense  contribution  to  the  psychological  study  of 
how  peopie  learn.  By  directly  exploring  new  cognitive  constructs 
along  with  psychophysics,  we  might  strengthen  the  bond  between 
cognitive  psychological  research,  neurological  brnn  research,  and 
instructional  design  theories.  This  would  lead  us  to  more  accurate 
descriptions  of  the  learning  process,  ne^  coiitructs  for  research, 
and  answers  not  to  whether  singers  or  songs  are  better,  but  why. 
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Introduction 

Richard  Claik's  article,  Reconsidering  Research  on  Learning  from  Media.  (1983), 
focused  our  attention  on  the  effectiveness  of  media  debate.  Clark  argued 
convincingly  that  media  do  not  have  a  substantial  impact  on  learning.  This 
sentiment  has  been  echoed  by  others  including  Clark  and  Angert  (1980)  who  argue 
that  "media  researchers  tend  to  operate  within  a  vacuum  and  rarely  acknowledge 
research  investigations  and  results  in  parallel  interests  in  other  fields"  (Moore, 
1986,  p.  190).  Since  the  debate  first  emerged,  one  of  our  latest  technologies, 
interactive  video,  has  continued  to  grow  in  use.  In  considering  the  media 
comparison  argument,  it  is  useful  to  examine  research  on  interactive  video.  Hie 
literature  on  interactive  video  can  be  classified  according  to  four  categories: 
reports  of  uses,  descriptions  of  features  and  capabilities  of  interactive  video, 
suggestions  for  design  (Braden,  1986),  and  research  and  evaluation  reports 
(Cushall,  1987).  This  paper  focuses  on  research  and  evaluation  reports. 

In  order  to  locate  studies  to  be  included  in  this  review,  a  number  of  methods  were 
employed.  In  addition  to  a  search  of  ERIC  documents  and  Psychological  Abstracts 
from  1985  -  1989,  working  papers  were  solicited  through  faculty  contact.  The 
studies  selected  for  inclusion  in  this  paper  meet  the  following  criteria:  (a)  All 
reports  included  pertain  to  research  or  evaluation  with  interactive  video.  Research 
on  computer-assisted  instruction  (CAI),  although  related,  is  not  reviewed  in  this 
paper,  (b)  All  studies  included  reported  some  form  of  data.  The  final  selection  of 
articles  included  both  published  and  unpublished  sources,  with  the  intent  of 
avoiding  a  publication  bias. 

Articles  concemed  with  reports  of  uses  or  capabilities  of  interactive  video,  or  with 
broad  conclusions  that  failed  to  present  data,  were  excluded  from  this  paper. 
Readers  interested  in  a  broad  review  of  interactive  video  are  referred  to  excellent 
articles  by  Smith  (1987)  and  Bijlstra  (1988).  In  addition,  interactive  video  research 
reported  from  1980  -  1984  has  been  reviewed  by  Bosco  (1987). 

In  their  recent  review  of  the  literature  on  media,  Clark  and  Sugrue  (1988)  analyze 
the  trends  and  identify  areas  for  future  research.  What  are  researchers  studying 
with  interactive  video  and  where  do  we  stand  in  terms  of  Clark's  media  comparison 
argument? 

Clark  and  Sugrue  (1988)  have  separated  the  literature  into  four  basic  areas.  This 
paper  examines  interactive  video  studies  according  to  the  same  categories: 
behavioral  issues,  cognitive  issues,  attitudinal  issues,  and  economic  issues.  The  first 
section  reviews  the  studies  that  can  be  categorized  as  investigating  variables  in  a 
behavioral  paradigm.  The  next  section  details  what  variables  have  been 
investigated  according  to  a  co^jnitive  perspective.  Hie  third  section  examines  what 
has  been  learned  from  the  investigation  of  variables  in  the  affective  domain. 
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Finally,  the  last  section  reviews  studies  which  were  concerned  with  economic 
issues.  The  tables  appended  to  this  paper  include  information  on  the  principle 
investigator,  subjects,  content  area,  sample  size,  and  variables  explored  for  each  of 
flie  articles  or  papers  reviewed.  This  is  similar  in  format  to  a  review  on  interactive 
video  reported  by  Bosco  (1986). 

Behavioral  Issues 

Clark  and  Sugme  propose  that  there  has  been  a  "paradigm  shift"  in  media  research 
from  a  behavioral  orientation  to  a  cognitive  orientation.  Is  this  evidenced  in  the 
research  conducted  with  interactive  video? 

While  there  has  been  a  shift,  there  are  still  a  number  of  media  comparison  studies 
where  interactive  video  is  compared  with  some  other  type  of  medium  (see  Table  I) 
such  as  computer  based  instniction  or  traditional  lecture  format.  Interactive  video 
has  been  compared  to  traditional  computer  based  instruction,  traditional  lecture, 
non-interactive  video,  print  based  material,  and  laboratory  exercises.  Generally, 
instruction  between  two  types  of  media  are  compared  and  effectiveness  is  defined  as 
a  score  on  a  retention  or  achievement  test.  While  many  of  these  studies  report  the 
superiority  of  the  interactive  video  medium  over  the  comparison,  close  inspection 
verifies  what  Claik  has  said  since  he  first  presented  his  media  comparison  argument 
in  1983,  the  "active  ingredient  is  usually  some  uncontrolled  aspect  of  the 
instructional  medium"  (p.23,  1988).  Rarely  does  one  hear  mention  that  the 
instructional  method  or  content  differences  may  account  for  the  seeming 
superiority  of  interactive  video. 

For  example,  Peterson,  et  al  (1988)  asked  whether  videodisc-based  programs  help 
teachers  achieve  high  levels  of  student  mastery  for  large  and  diverse  classes.  They 
studied  all  of  the  fifth  giade  classes  in  Logan,  Utah  (n=:l  1)  on  a  level  one  application 
of  interactive  video  and  pre/post  tested  the  students  on  embe  'ded  unit  mastery  tests. 
The  posttest  mastery  scores  were  at  the  70%.  In  addition,  scores  on  the  CTBS  were 
compared  to  tlie  previous  year's  CTBS  test  scores  and  genera)  improvement  was 
cited.  In  conclusion,  the  authors  highlighted  the  ease  of  use  of  the  videv^disc  and  felt 
that  its  use  contributed  to  the  gains  in  the  CTBS  scores  as  compared  to  the  previous 
year  when  only  "traditional  instruction"  was  offered.  It  seems  that  this  study  is 
lacking  in  validity  in  a  number  of  ways.  That  is,  how  do  the  individual  modules 
correlate  with  the  CBTS  test  items?  Is  70%  mastery  significantly  better  that  what 
the  mastery  would  be,  given  instruction  in  the  traditional  sense?  The  specific 
planning  involved  in  the  design  of  the  level  one  application  may  have  accounted  for 
the  variation  in  the  test  scores.  Also,  with  small  sample  sizes  which  are  typical  of 
the  interactive  video  studies  reviewed,  findings  are  not  generalizable. 
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When  one  is  examining  the  effects  of  different  media,  everything  except  the  media 
conipared  must  be  the  same,  including  instructional  methods  employed  and  content. 
While  content  generally  is  held  constant  in  these  media  comparison  studies,  the 
instructional  methods  employed  are  not.  Maloiif  et  al  (1986)  tried  to  control 
instructional  methods  in  a  study  comparing  interactive  videotape  and  workbook 
instruction  of  on-the-job  skills  for  mildly  handicapped  teenagers.  In  order  to  match 
the  two  media  as  much  as  possible,  each  of  the  instructional  activities  in  the 
videotape  had  a  parallel  activity  in  the  workbook.  Also,  a  single  instructor 
delivered  both  treatments.  While  the  videotape  treatment  was  found  to  be  superior, 
Malouf  acknowledges  the  confounding  effect  of  novelty  due  to  the  brevity  of  the 
treatment. 

I  wouiu  like  to  suggest  that  there  are  reasons  that  the  instructional  methods 
employed  are  not  held  constant.  Often,  the  media  comparison  study  examines 
already  prepared  lessons,  or  at  best,  one  prepared  lesson  and  one  lesson  specifically 
designed  for  research  purposes.  If  we  were  not  so  quick  to  utiUze  existing  discs,  we 
might  be  more  careful  in  our  design  of  instractional  methods  for  the  treatments. 

Often,  and  I  have  experienced  this  myself,  one  is  presented  with  an  opportunity  to 
"rcpurpose"  a  disc  for  the  purposes  of  research.  Now,  one  might  know  that  a 
number  of  examples  need  to  be  presented  for  the  learner  to  fiilly  grasp  the  content, 
however,  if  there  are  just  three  pieces  of  video  footage  on  the  disc  appropriate  for 
examples,  one  compromises  knowledge  about  instructional  strategies  for  the 
purpose  of  designing  and  conducting  the  research  study.  It  is  difficult  to  teach  a 
principle,  for  example,  with  only  three  examples.  However,  a  "fact"  level  lesson 
might  be  constructed  with  just  three  examples~and  there  we  have  a  "compromise" 
in  terms  of  our  research  design.  If  we  are  going  to  repurpose  discs  for  the  purpose 
of  research,  we  should  at  least  use  some  of  the  guidelines  that  have  been  suggested  in 
the  literature  (Allen,  1986). 

Perhaps  the  continued  existence  of  media  comparison  studies  is  not  too  surprising 
when  one  considers  that  many  of  these  studies  are  commissbned  by  the  producers 
of  the  interactive  videodiscs  or  the  hardware  who  are  looking  for  justification  that 
their  method  is  "right."  Do  we  really  need  to  compare  in  order  to  justify?  In  many 
instances  it  seems  that  it  would  be  more  appropriate  to  evaluate  with  the  purpose  of 
optimizing  one  particular  medium.  This  is  especially  true  because  media  are  often 
pre-selected.  Fortunately,  the  recent  research  studies  conducted  with  interactive 
video  have  shifted  toward  exploring  cognitive  variables. 
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Cognitive  Issues 

Another  of  Clark  and  Sugrue's  categories  is  that  of  cognitive  issues.  In  the  studies 
examined  for  this  paper,  there  is  reference  to  these  cognitive  issues  but  there  are 
rare  accounts  of  studies  which  have  been  conducted  in  order  to  quantify  or 
understand  some  of  the  cognitive  issues.  For  example,  can  media  activate  mental 
skiUs?  Claik  and  Sugrue  (1988)  suggest  that  "future  media  research  would  do  well 
to  asY  not  just  whether  particular  skills  are  acquired  but  also,  how  else  they  could  be 
developed,  and  under  what  instructional,  contextual,  and  psychological  conditions 
they  can  be  made  to  transfer."  p.  29.  Many  studies  have  examined  interactivity, 
feedback,  and  practice.  While  these  variables  could  be  classified  as  elements  of 
instructional  strategies  rather  than  cognitive  variables,  typically  the  researchers 
have  been  interested  in  the  effects  o*  these  variables  on  information  processing 
which  results  in  learning.  For  example,  does  increasing  the  'interactivity'  enable 
learners  to  process  information  more  effectively,  and  affect  how  much  information 
is  retained? 

A  few  of  these  of  studies  will  be  described  here.  Additional  studies  are  included  in 
the  table  appended  to  this  paper  (see  Table  I).  Results  from  a  study  conducted  by 
Hannafm,  Phillips,  and  Tripp  (1986)  suggest  that  the  availability  of  orienting 
activity  affects  both  the  type  and  amount  of  leiuning.  Smdents  given  an  orienting 
activity  performed  best  under  reduced  time  while  students  who  were  not  provided 
with  orienting  activities  performed  best  with  extended  time.  There  were 
interactions  between  orienting  activities  and  processing  time,  suggesting  that 
neither  element  alone  affects  learning.  This  is  an  example  of  a  study  that  uses 
interactive  video  as  a  research  tool.  One  can  imagine  a  similar  study  conducted 
without  an  interactive  videodisc  and  replications  of  these  results  could  be 
generalized  to  a  variety  of  leaming  situations. 

In  addition  to  orienting  activities,  the  influence  of  practice  for  different  typts  of 
leaming  has  been  investigated  and  the  results  are  not  uniform.  In  an  investigation 
conducted  using  interactive  video  (Hannafin  &  Colamaio,  1986),  practice  was 
found  to  be  important  for  the  leaming  of  declarative  knowledge  and  problem 
solving  skills,  but  of  little  effect  for  procedural  knowledge.  A  later  study 
conducted  by  Hannafin,  Phillips,  and  Tripp  (1986)  investigated  the  effects  of 
prac**  :e  and  processing  time  on  leamir  Their  subjects  were  80  volunteer  college 
stuo,  its.  The  practice  items  consisted  two  multiple  choice  questions  (one  fact, 
one  application).  The  posttest  consisted  of  32,  five  part  multiple  choice  questions. 
One-half  of  them  (eight  fact,  eight  application)  were  practiced  during  the  lesson  and 
the  remaining  16  items  were  new  items.  Practice  resulted  in  favorable  results  only 
for  ihe  facts  where  test  scores  more  than  doubled  the  scores  for  non-practiced  items 
(90%  correct  lo  44%).  However,  test  items  at  the  application  level  were  unaffected 
by  practice. 
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One  concern  about  these  types  of  studies  is  whether  or  not  they  employ  an  adequate 
lesson  format.  The  National  Gallery  of  Art  Tour  has  been  adapted  for  the  purposes 
of  many  of  these  studies  (Hannafin,  Phillips,  and  Tripp,1986;  Hannafin  & 
Colamaio,  1986;  Jonassen,1987;  Phillips,  Hannafin,  and  Tripp,  1988).  One 
wonders  whether  there  are  even  sufficient  numbers  of  examples  and  practice  items 
present  in  these  sequences  of  instruction,  since  the  lessons  are  adapted  from  the 
existing  tour.  If  the  practice  is  simply  rehearsal,  then  it  is  not  surprising  that  the 
results  showed  practice  to  be  effective  for  facts  only,  and  not  application  exercises. 
This  finding  was  also  consistent  with  the  earlier  Hannafin  &  Colamaio  (1986)  smdy. 
If  we  accept  the  conclusions  as  given,  the  insertion  of  interactions  in  a  lesson  in  the 
form  of  practice  might  not  be  relevant  for  the  application  level  of  learning 
performance,  as  this  study  demonstrated.  However,  this  is  in  contradiction  to  most 
of  the  research  on  Component  Display  TTieory  (Merrill  &  Tennyson,  1977). 

While  some  features  of  interactive  video  mav  be  desirable  for  reasons  other  than 
learning  effectiveness  (i.e.  attimdinal  impact),  the  Hannafin  and  Colamaio  (1986) 
study  suggests  that  there  may  be  limits  to  the  effects  of  the  interactions  (in  this  case, 
practice).  In  terms  of  interactive  video,  this  could  mean  that  maximizing  the 
capabilities  of  branching  has  little  effect  on  learning.  If  these  results  were  analyzed 
from  a  cost  effectiveness  point  of  view,  many  interactions  would  be  unnecessary, 
and  a  waste  of  time.  Of  course,  "practice"  needs  to  be  investigated  more  before 
such  conclusions  are  drawn  and  interactive  video  as  a  research  tool  might  be 
extremely  helpful  in  this  regard;  however,  the  typical  treatment  would  have  to  be 
revised  radically. 

A  related  smdy  (Phillips,  Hannafin,  and  Tripp,  1988)  looked  at  practice  and 
orienting  activities  on  leaming  from  interactive  video.  Seventy- two  college 
students  were  randomly  assigned  to  an  orienting  group  and  to  one  of  three  practice 
groups:  No  practice.  Limited  practice,  or  Elaborate  practice.  The  lesson  included 
both  fact  and  application  level  leaming  of  concepts  in  art.  Smdents  were  measured 
on  a  posttest  which  consisted  of  16  new  and  16  repeated  items  for  facts  and 
applications  taught  during  lesson.  The  means  between  the  three  groups  were  only 
found  to  be  significant  on  the  repeated  items.  There  was  not  a  significant  difference 
between  die  different  types  of  practice  on  the  test  items  which  were  not  included  in 
the  lesson.  The  orientation  activities  themselves  did  not  contribute  to  leaming  as 
measured  in  this  study. 

This  study  warrants  special  consideration.  It  is  not  surprising  that  there  was  a 
significant  effect  of  elaborate  practice  on  the  retention  of  the  repeated  items.  The 
authors  were  trying  to  measure  the  effects  of  practice  on  two  different  performance 
levels:  fact  and  application,  however,  the  inclusion  of  so  many  repeated  items 
reduces  the  experiment  to  a  measure  of  pure  recall.  In  order  to  test  the  effect  of 
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practice  on  application  level  learning,  the  lesson  should  be  redesigned  to  include 
new  instances  at  the  test  level. 


I  suggest  that  we  advance  our  design  of  the  lessons  that  we  employ  when 
investigating  interactive  video.  Some  of  the  features  of  interactive  video  would  be 
especially  helpful  in  the  investigation  of  instruction  at  the  principle  or  procedural 
level;  however,  it  would  entail  additional  design  time  and  possibly,  the  creation  of 
discs  for  the  specific  purposes  of  research. 

Jonassen  (1987)  investigated  the  effect  of  practice  on  prototype  development  in  a 
concept  lesson  in  art  history,  utilizing  the  National  Gallery  of  Art  disc.  TTiirty 
college  students  participated  in  the  study  which  measured  (a)  prototype  only,  (b) 
prototype  and  practice,  and  (c)  prototype,  elaboration  and  practice.  The  prototype 
only  treatment  presented  the  name  of  the  style  of  art,  plus  three  examples.  TT.e 
prototype  and  practice  presentation  was  the  same  as  the  prototype  only  treatment, 
except  that  there  were  ten  additional  practice  items  and  knowledge  of  results  were 
provided  to  the  learner.  The  prototype  and  elaboration  and  practice  presentation 
was  identical  with  the  previous  treatment  except  that  it  included  an  imaging 
strategy.  Students  were  asked  to  close  their  eyes  and  imagine  three  characteristics 
of  that  type  of  painting  and  type  their  answers  into  the  computer.  This  required  the 
most  elaborate  practice  (or  in  this  case,  "active  processing")  by  the  learner.  The 
results  showed  that  the  prototype  only  group  differed  significantly  from  the  other 
two  groups  on  the  posttest  scores.  However,  there  was  not  any  difference  between 
the  prototype  and  practice  and  prototype,  elaboration  and  practice  groups. 

It  is  difficult  to  determine  whether  or  not  the  subjects  performed  the  mental 
rehearsal  strategy  and  to  what  extent  they  did.  If  in  fact  they  did,  and  if  the  results 
could  be  replicated  with  a  larger  sample  size,  this  study  might  provide  evidence  that 
additional  practice  in  the  form  of  mental  rehearsal  can  be  urmecessary  for  concept 
level  learning.  However,  a  study  which  examined  principle  or  procedural  leaming 
might  determine  that  mental  imaging  is  important  in  far  transfer  for  these  levels  of 
leaming. 

Basically,  we  are  making  progress  in  the  pursuit  of  investigating  cognitive  issues 
with  interactive  video  as  a  research  tool.  Our  weakness  seems  to  be  in  the  actual 
lesson  design  of  the  discs  employed  to  investigate  the  various  variables.  As  studies 
improve  in  this  regard,  we  should  be  able  to  investigate  learner  differences  and 
processing  variables.  In  addition,  the  features  of  CBIV  would  enable  us  to  examine 
research  questions  concerning  procedural  leaming,  principle  leaming,  generic 
skills,  and  instructional  strategies. 
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Affective  Issues 

Motivation  theory  answers  not  only,  "Did  I  like  it"  but  whether  the  task  is 
enjoyable,  what  skills  are  requir-^d  to  learn  from  the  task,  and  do  I  have  the  skills  I 
need  to  learn  from  the  task?  These  questions  refer  to  not  only  whether  a  learner  has 
a  particular  preference  for  a  type  of  medium  but  also  tO  the  amount  of  effort  that 
will  have  to  be  invested  in  order  to  learn  from  a  particular  task.  The  research  in 
this  specific  area  is  sparse.  However,  many  of  the  studies  in  the  literature  report 
some  measure  of  preference  such  as  'the  learners  preferred  the  interactive  video 
over  traditional  lecture'  but  this  is  usually  a  secondary  measure  whereas 
achievement  is  of  primary  concem.  Clark  and  Sugrae  (1988)  urge  researchers  to 
measuie  engagement,  levels  of  effort,  perceived  demand  characteristics,  and  self 
efficacy. 

Have  any  of  these  variables  been  studied  with  regards  to  interactive  video?  Not  yet. 
While  there  have  been  reports  related  to  values  and  attitudes,  these  are  confounded 
because  the  intent  of  the  study  is  usually  to  measure  achievement.  One  recently 
reported  study  (Bosco  &  Wagner,  1988)  assessed  the  attitude  of  auto  workers 
toward  interactive  video  as  compared  to  classroom  instruction  with  video  tape.  All 
workers  received  instruction  in  both  formats  and  since  both  fomats  were  new  to 
the  workers,  the  researchers  felt  that  this  would  control  for  the  Hawthorne  Effect. 
Often,  studies  examining  interactive  video  ask  the  subjects  to  report  their 
preference  to  something  that  the  subjects  reflect  back  upon  whereas  this  study 
investigated  attitudes  after  all  of  the  subjects  experienced  both  treatments.  The 
content  area  was  instruction  on  the  handling  of  hazardous  materials.  When  workers 
reported  on  their  attitudes  toward  interactive  video  as  compared  to  the  classroom 
and  videotape  instruction  received  in  the  treatment,  they  responded  more  favorably 
to  interactive  video.  Thus,  if  one  is  in  a  situation  where  either  type  of  training  is 
available,  this  evaluation  St^^y  suggests  that  workers  prefer  interactive  video. 

I  include  here  a  related  study  that  might  provide  a  future  direction  fc.  research  on 
media  attributes  and  attitudes.  A  study  conducted  by  Simonson,  et  al  (1987) 
suggests  that  attitudes  can  be  modified  by  using  media  to  deliver  messages,  and  that 
sonie  types  of  media  may  be  more  effective  than  others  in  modifying  attitudes. 
While  the  Simonson  and  his  colleagues  compared  motion  pictures  and  slide  tapes, 
this  might  be  an  area  for  further  investigation  and  one  that  could  be  researched 
using  interactive  video  as  a  tool.  This  type  of  study  moves  away  from  the  media 
comparison  format  of  the  past.  If  everything  else  is  held  constant,  it  might  be  that 
motion  is  an  important  consideration  when  provid'  ig  visual  images  that  lead  to 
attitude  change.  If  it  were  determined  that  one  needs  to  get  as  close  to  realism  as 
possible  when  designing  instruction  for  attitude  change,  then  interactive  video 
might  be  the  most  appropriate  choice  when  mediated  instruction  is  desired. 


157 


Economics  and  Cost-effectiveness 

Clark's  media  argument  was  criticized  by  Petovitch  .  '  Temiyson  (1985),  who 
pointed  out  that  while  some  media  may  not  be  more  effective  than  others  in  terms  of 
learning,  they  might  be  more  cost  effective.  Cost  effectiveness  is  an  important 
consideration  because  it  is  a  variable  that  can  contribute  t.->  the  types  of  decisions 
many  clients  need  to  make  when  considering  mediated  jnstruction.  However, 
results  from  economic  studies  will  not  provide  insights  into  instructional  theory. 
Still,  they  are  an  area  for  needed  research. 

There  have  only  been  induect  measures  of  variables  that  relate  to  cost-effectiveness 
issues.  Learning  acquisition  rate  was  measured  by  Schaffer  and  Hannafm  (1986)  in 
a  study  that  examined  four  video  treatments  which  differed  in  amounts  of 
interactivity.  The  four  treatments  were:  linear  video  only,  video  with  embedded 
questions,  video  with  questions  and  feedback,  and  fully  interactive  video  (video, 
embedded  questions,  feedback,  and  remediation  through  branching).  Schaffer  and 
Hannafin  (1986)  computed  the  amount  of  recall  versus  instmctional  time  and  called 
this  ratio,  acquisition  rate.  The  linear  video  treatment  had  the  highest  acquisition 
rate  score.  Tho  authors  concluded  that  the  most  efficient  use  of  time  versus 
learning  is  the  non-interactive  linear  video.  However,  the  highest  recall  scores 
resulted  from  the  fiilly  interactive  treatment.  This  study  did  not  determine  whether 
the  increase  in  recall  could  be  due  to  the  reased  length  of  instmctional  time. 
However,  this  study  did  demonstrate  that  for  instmctional  circumstances  requiring 
a  great  deal  of  recall,  interactivity  is  well  suited.  Perhaps  the  most  important 
question  is  not  whether  interactivity  enhances  learning  but  whether  it  does  so 
sufficiently  to  warrant  the  increased  instructional  time,  and  whether  in  view  of  this 
time/cost  consideration,  it  is  a  feasible  medium 

Finally,  a  number  of  articles  (Smith  and  Dunn,  1987  and  Peterson,  et  al.  1988)  cite 
productivity  gains  due  to  the  use  of  CBIV.  Teachers  report  feeling  less  pressure 
and  increased  teacher-student  interactions  as  a  result  of  being  freed  from  the  more 
'mundane  tasks'  of  instruction. 

The  reader  is  referred  to  Levin  (1987)  and  Levin,  Glass  and  Meister  (1985  )  for 
examples  of  the  type  of  cost  effectiveness  studies  that  might  be  conducted, 
examining  interactive  video.  Levin  (1987)  examined  the  cost-effectiveness  of  CAI, 
peer  tutoring,  reduced  class  size,  and  increased  instmctional  time  (number  of  days 
in  school),  CAI  was  found  to  be  more  cost  effective  that  increasing  instmctional 
time  or  decreasing  class  size.  Levin  suggests  that  the  time  and  effoit  needed  to 
obtain  a  given  level  of  learning  efficiency  will  decline  as  the  technology  of  learning 
resources  improves.  Students  will  "wish"  to  allocate  more  time  to  learning 
activities  as  their  efficiency  in  producing  leaming  rises  relative  to  their  efficiency 
in  the  production  of  leaming  activities.  This  is  an  area  of  research  which  could 
have  direct  implications  for  media  selection  decisions. 
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Conclusions 

The  analysis  in  this  paper  might  leave  the  reader  feeling  that  there  is  litde  to  argue 
for  the  effectiveness  of  interactive  video  and  that  we  haven't  made  much  progress 
since  Clark  first  presented  his  "mere  vehicles"  argument.  In  terms  of  interactive 
video,  I  agiee  with  Claik  and  suggest  that  we  are  asking  the  wrong  questions. 
While  many  of  the  reports  included  in  this  paper  and  the  appended  tables  conclude 
with  a  statement  about  the  effectiveness  of  interactive  video,  increasing  numbers 
are  reporting  data  relating  to  instructional  variables.  Tnerc  is  much  to  warrant  the 
use  of  interactive  video  as  a  research  tool.  Specifically,  its  ability  to  combine  video, 
audio,  text,  and  motion,  as  well  as  its  branching  capabilities  suggest  that  interactive 
video  can  be  extremely  useful  for  presenting  and  collecting  data  in  a  controlled 
way.  We  MUST  re-orient  ourselves  toward  conducting  research  on  Instructional 
strategies  or  affective  variables  that  lead  to  formulating  generalizable  theory.  In 
addition,  an  increased  focus  on  the  evaluation  of  interactive  video  discs  and  their 
uses  would  enable  us  to  optimize  the  medium  for  particular  situations,  types  of 
content,  and  types  of  learners.  As  Heinich  (1984)  as  argued,  the  main  purpose  of 
media  research  is  to  improve  rather  than  prove  media"! 

If  we  arc  oriented  to  this  end,  it  is  likely  that  the  media  comparison  studies  which 
attempt  to  link  interactive  video  with  specific  learning  gains  will  disappear 
completely.  I  will  be  happy  if  in  ten  years,  when  reviewing  this  body  of  research 
literature,  I  fmd  no  mention  of  interactive  video  until  I  reach  the  methods  section  of 
an  article.  There,  perhaps  in  the  fine  print,  will  be  a  phrase  such  as,  "interactive 
video  was  used  to  present  the  treatments  and  recoid  the  data." 

This  suggestion,  that  interactive  video  be  used  as  a  research  tool,  is  not  new  (see,  for 
example,  Grabowski  and  Pearson,  1988)  however,  it  has  been  underutilized.  It  is 
much  easier  to  construct  experiments  using  existing  videodiscs.  I  have  yet  to  read 
about  a  videodisc  that  was  specifically  constructed  for  the  purpose  of  research. 
Yes,  there  arc  many  discs  constructed  for  particular  courses  via  IV  that  have 
formative  evaluation  built  in  to  the  development  process.  Many  of  these  evaluations 
have  taken  the  form  of  quasi-experimental  studies  and  some  of  the  results  have  been 
reviewed  in  this  paper  and  the  appended  tables.  However,  the  results  are  intended 
to  provide  mformation  specific  to  that  particular  program,  not  to  generalizable 
theory  about  instructional  design. 

What  can  be  done  about  this?  Imagine  the  generic  research  disc  that  Jonnasen 
(1984)  first  described-  one  that  had  a  host  of  instructional  treatments,  presentation 
forms,  events  of  learning,  generic  skills.  Such  a  disc  might  take  a  long  time  to 
develop  and  for  the  ore  shot  treatment  would  certainly  be  inappropriate.  However, 
once  developed,  a  number  of  studies  could  be  conducted  with  a  host  of  samples. 
The  lessons  employed  in  the  treatments  would  be  designed  in  the  "ideal",  according 
to  instructional  design  principles,  not  according  to  the  need  for  a  quick  instructional 
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treatment  to  crank  out  some  results.  It  has  been  difficult  to  evaluate  the  actual 
results  of  some  of  the  studies  reported  simply  because  the  format  of  the  lesson  is  not 
fully  described  in  the  report.  Is  it  a  concept  lesson,  principle,  etc?  Is  recall  being 
measured  again?  Are  we  not  beyond  recall  in  our  knowledge  of  prior  research? 
This  review  of  the  literature  on  interactive  video  research  demonstrates  that  while 
we  have  continued  to  conduct  media  comparison  studies,  we  are  beginning  to 
research  variables  which  might  have  more  generalizable  findings.  The  promise  lies 
in  using  interactive  video  as  a  research  tool.  In  addition,  we  need  to  conduct 
evaluation  studies  (see  Reeves,  1986  for  suggested  models)  on  the  medium  itself,  in 
order  to  optinilze  its  features  and  capabilities. 
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Principle 
Investigator 


Subject 


Independent 
Variables 


Dependent 
Variables 


Results 


Bosco(1988) 


General  hazardous 
Motors  materials 
workers 


209      •  level  in  interactive 
video  disc 
•videotape 


•achievement 
onposttcst 

•  opinion  snuvey 

•  user  intference 
instrument  to 
measure  attitude 


►  subjects  had  higher  achievement  with  IV 

►  subjects  tended  to  prefer  IV  but  subjects 
exhibited  positive  attitudes  towards  both 
medic's 


Braiicc(1987) 


Veterinary  heart  87 
Students  auscultation 


» videodisc 
&  lecture 
'  lecture  only 


*  perfcmnance  on      •  video  group  more  positive  about  learning 
{tactical  exam       •  quality  of  vide<xiisc  rated  good 

•  no  sipificant  difference  between  the  groups  on 
tlie  practical  exam 

•  video  group  began  to  listen  only  and  not  attend 
to  video 


Cmer(1985) 


niildly  budgeting 

handic«fq)ed 

teenagers 


26       •brief  feedback 

•  extemkd  feedback 


•  acquii  don  of  •  no  significant  difference  in  perfonnance 
COTcepts  •  interactive  videodisc  group  exhibited 

less  negative  reaction  to  content 


DaIiun,D.W.(1986) 


junior 
high 


general 
shop 
saftty 
rules 


134     •  video  only 
•CAIonly 
•Interactive  video 


•  perf(»inance 
•attitude 


•CAI  most  effective 

•  rv  produced  improvements  in  learner 

attimdes  compared  to  CAI  and  video 
>  attitude  effects  interacted  differed  across 

prior  achievement  level 


ERLC 


ICG 


TnS^^^^^  Subjects      Subject       n        Independent       Dependent  Results 

mvestigaior  ^  Matter  Variables  Variables 


Grovcr(1986) 


adult 


languageft 

sociocultural 

infiniiatkm 


64 


'  interactive 
video 

•  linear  video 


*  content  acquired 
'  attitude;  changes 

•  self  reported 
bdiavior  change-s 


•  no  significant  differences  between  the  two 
groups  in  tenns  of  achievement  and  perceived 
difficulty 


Hannafin  (1986) 


college 


art 


80 


'  achievement 
onposttest 


*  achievoncait  on 
posttest 


'  practice  found  to  be  effective  at  the  tact  level; 
no  effect  for  applications  level 


Ho  (1986) 


college  & 
graduate 


installing 
computer 
int^ace 
hoards 


•  computer 
controlled 
review 

•  learner  controlled 
review 

•  no  review 

•  objectives 

•  no  objectives 

•  verbal  info, 
concepts,  rules 


•  achievement         •  Both  ccmiputer  and  learner  controlled 
on  posrtcst  review  found  to  have  a  signifcant  effect 

on  posttest  scores.  No  difference  between 
learner  and  ccnnputer  controlled  conditions 

•  Learner  controlled  review  significant  for 
concepts  only 

•  Multivariate  analysis  did  not  produce 
significant  differences  for  objectives 
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Jonassen  (1987)         college  at 


30  •  prototype  oiJy    •  achievement 

•  prototype  &       on  posttest 
practice 

•  prototype, 
elaboration, 
practice 


•  sample  size  too  small  for  broad  conclusions 
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LyncssAi.(1985) 


nursing  cPr  100 
students 


*  Conventional 

instniction 
>  Interactive  video 

imiruction 


'  Skill  •  no  significant  differences  between  traditional 

'  Knowledge      CPR  and  interactive  video 

•  interactive  video  supericH-  for  obstructed  airways 


Malouf(1986) 


hi^  school     (XI  the  job  48 
learning         social  skills 
disabled 


'  intcactive  videot£q)e  •  score  cm 
►  workbook  criterion 
'  no  treatment  reference 
test 


Interactive  videos  found  to  be 
superiOT  to  workbook  instruction 
on  identical  objectives 


PhiUips(1988) 


0» 

CO 


College  Art 


72      •  no  practice 

•limited  practice 
•elaborate  practice 


•  retentkm        *  Practice  found  to  be  effective 

at  the  fact  level  for  repeated  items 
«  No  significant  difference  found 
for  pract^^e  on  unencountered  items 


Smith  (1986) 


College         Chcmisny  103 


►  IV  lesson  only      •  grade  on  lab  •  IV  and  IV  +  lab  group  scored  higher 

►  traditional  lab        repon  than  traditional  lab  on  quiz 

►  IV  lesson  &  lab     •  performance  .  iv  lab  scores  were  higher  than  traditional 

on  quiz  lab  reports 
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The  Effect  of  Graphic  Format  on  the 
Jnterpretatlon  of  Quantitative  Data 

Introduction 

The  power  provided  by  computer  graphics  systems  has  greatly  facilitated  the 
production  of  profe  iional  quality  graphic  materials.  The  versatility  provided  by  the 
software  has  made  it  possible  to  present  numerical  information  in  a  multitude  of  chart 
formats.  Most  software  packages  allow  the  users  to  readily  display  the  same  data  in 
a  variety  of  different  formats  by  a  few  simple  keystrokes.  However,  educators  and 
instructional  designers  still  lack  th*:  empirical  evidence  to  assist  them  in  determining 
the  "right"  type  of  graphics  to  use  in  a  given  learning  situation. 

Washburne  (1920  investigated  the  effects  of  tabular,  textui    and  g  aphic 
arrangements  on  recall.  This  study  tesied  recall  of  specific  amounts,  as  well  as  static 
ami  dynamic  comparisons  and  rank  orderif,g.  Watson  and  Driver  (1983)  found  that 
three  dimensional  graphic  plots  did  not  result  in  greater  recall  of  information  than 
did  tabular  presentation  data.  Benbasat  and  Dexter  (1986)  concluded  that  tabular 
reports  led  to  better  decision  making  and  graphical  reports  led  to  taster  decision 
making  when  time  constraints  were  low.  However,  a  combined  graphical-tabular 
report  was  found  superior  in  terms  of  performance.  Even  though  the  use  of  graphics 
In  instruction  has  generally  been  recommended  in  th3  literature  (e.g.,  Miller,  1969; 
Shostack  &  Eddy,  1971;  Takeuchi  &  Schmidt,  1980),  there  have  not  been  extensive 
studies  which  investigated  the  effects  of  these  formats  on  recall. 

The  general  advantages  of  graphics  in  presentations  have  been  delineatec'  by 
Watson  and  Driver  (1983).  Some  of  these  advantages  include  1)  the  ability  to 
stimulate  the  interest  of  the  user,  2)  to  aid  in  grasping  relationships,  3)  to  save  time 
when  viewing  masses  of  data,  4)  present  at  a  glance  a  comprehensive  view  of  the 
relationship  between  different  categories  of  information,  and  5)  to  assist  in  analytical 
thinking.  However,  there  appears  to  be  a  lack  of  research  that  supports  the  above 
claims.  Winn  (1987,  p.  192)  stresses  the  importance  of  developing  "lines  of  inquiry 
into  the  learning  strategies  studies  use  when  working  with  graphic  forms.''  It  is 
important  to  discover  how  and  what  students  are  learning  from  graphics.  Are  some 
graphics  more  effective  than  others?  Are  some  types  of  information  better  presented 
different  in  graphic  forms?  Designers  and  producers  of  visual  materials  must  also 
be  concerned  with  a  number  of  considerations  included  the  nature  of  the 
instructional  task,  the  teaching  and  learning  strategies  to  be  employed,  and  the 
individual  characteristics  o!  the  learner. 

The  term  cognitive  style  has  been  employed  to  describe  strategies  or  models  of 
perceiving,  organizing  and  processing  stimuli.  The  cognitive  style  of  field 
dependence  has  been  singled  out  as  having  major  implications  in  the  use  of  visual 
materials.  Field  dependence  is  important  because  it  invc  Ves  perceptual  and 
problem-solving  abilities,  structuring  a  stimulus  field,  breaking  up  or  disembedding 
such  a  field,  suppressing  irrelevant  information,  and  dealing  with  high  Inform^*!'-  . 
load,  all  of  which  are  relevant  in  the  interpretation  of  data  in  graphic  format.  More 
specifically,  it  is  of  interest  if  there  is  any  correlation  between  the  various  graphic 
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formats  and  those  individuals  who  are  classified  as  field-dependent  or 
field-independent.  Field  dependent  students  may  have  difficulty  processing  complex 
visual  information  (i.e..  as  a  graphic  format)  unless  it  is  presented  in  such  a  way  as 
to  compensate  for  specific  processing  deficiencies  related  to  field-dependence. 

Research  Questions 

The  purpose  of  this  study  was  to  determine  the  effect  of  graphic  format  on  the 
interpretation  of  numerical  data.  The  formats  used  in  this  study  were  bar.  line,  table, 
and  line-table  graph.  The  three  types  of  quantitative  interpretation  that  were  tested 
were  specific  amounts,  and  static  and  dynamic  comparisons.  It  was  also  of  intertot 
to  determine  whether  cognitive  style  (FD/FI)  correlated  with  the  ability  of  the  subjects 
to  interpret  information  in  any  particular  chart  format. 

Methodology 

The  subjects  for  this  study  were  96  undergraduate  college  students  enrolled  in 
professional  education  classes  or  introductory  educational  psychology  classes  within 
the  College  of  Education.  The  subjects  were  given  Group  Embedded  Figures  Test 
(Witl^in,  Oltman,  Raskin  &  Karp,  1971).  The  scores  range  from  0-18  with  the  higher 
scores  indicating  tendency  toward  field  dependence. 

The  subjects  were  randomly  assigned  to  one  of  four  treatments  which  presented 
fictitious  data  in  graphic  form  to  alleviate  any  effect  of  prior  l^nowledge.  The  fictitious 
data  dealt  with  variou.«;  European  merchants  income  during  the  middle  ages.  The 
four  treatments  presented  the  same  data  in  the  following  formats:  1)  bar  graph,  2)  line 
graph,  3)  table  and  4)  line-table  combination.  During  the  testing  phase  subjects 
responded  by  giving  numerical  or  verbal  answers  in  three  categories:  specific 
amounts  as  well  as  static  and  dynamic  comparisons  of  the  data.  Example  questions 
for  each  category  are  presented  below. 

Specific  Amount 

What  was  the  income  of  the  silk  merchants  in  the  year  11P0? 
Static  comparison 

Which  group  of  merchants  had  the  highest  income  in  the  year  1350? 
Dynamic  comparison 

Which  group  of  merchants  had  the  greatest  increase  in  income  between  the 
years  1100  and  1200? 

All  subjects  in  all  treatments  answered  the  same  questions  (each  in  the  above 
three  categories)  the  order  of  which  was  randomly  altered  for  eich  treatment.  The 
subjects  were  given  the  fictitious  narrative  and  then  shown  a  graphic  format  of  the 


ERIC 


170 

177 


4 


quantitative  data,  e.g.,  line  graph  on  35mm  slide.  The  subjects  had  seven  seconds 
to  respond  to  each  question  while  looking  at  the  treatment  slide,  e.g.,  line  graph. 

A  two-way  analysis  of  variance  was  used  to  test  the  various  null  hypothesis  in 
which  the  independent  variables  are  type  of  graphic  and  type  of  recall.  The  design 
was  3x2  factorial  design  based  upon  a  mixed  model  which  used  a  combination  of 
between  and  within  subjects  methods  (all  subjects  would  respond  to  all  types  of 
questions)  while  viewing  only  one  type  of  graph.  The  dependent  variable  was  the 
interpretation  of  quantitative  information.  A  correlation  was  conducted  using  the  raw 
scores  total  and  score  on  the  (GEFT)  (0-18)  for  each  subject. 

Results 

The  means  of  the  raw  scores  are  presented  in  Table  1  and  the  means  of  the 
scores  as  percent  correct  responses  are  presented  in  Table  2.  A  two  dimensional 
(3x2)  analysis  of  variance  design  was  employed  to  test  the  research  hypothesis.  The 
summary  table  of  the  analysis  of  variance  based  upon  the  table  of  means  (Table  1) 
is  presented  in  Table  3.  A  total  of  96  subjects  were  used  in  this  analysis.  The  F  ratio 
for  type  of  graph  (F(3,92)  =  4.71,  £  <  .005)  was  significant.  The  F  ratio  for  type  of 
question  (F(2,184)  =  46.56,  £  <  .0001)  was  also  significant.  The  F(6,184)  =  .107,  2 
>  .05)  between  type  of  graph  and  type  of  question  was  not  significant.  The 
correlation  coefficient  of  scores  on  the  GEFT  and  the  scores  on  the  three  types  of 
questions  was  as  follows:  amount  =  0.078.  static  =  0.182,  and  dynamic  =  0.381. 
Figure  1  is  a  graphical  representation  of  the  means  of  the  percent  scores  as  function 
of  type  of  graph  and  type  of  question. 

Discussion 

The  post-hoc  analyses  of  comparisons  of  means  showed  that  Ss  viewing  the  line 
graph  had  lower  scores  than  for  the  table  treatment  for  all  three  types  (amount,  static, 
dynamic)  questions.  This  is  a  predicted  result  for  the  amount  questions  because  the 
subjects  :mpfy  had  to  read  the  data  from  the  table.  However,  since  the  static  and 
dynamic  questions  required  the  Ss  to  do  comparisons  in  a  given  year  (static)  and 
scan  across  years  (dynamic),  the  poor  performance  of  the  line  treatment  was 
unexpected  and  merits  additional  experimental  work. 

Subjects  viewing  the  bar  graph  did  not  differ  from  the  line  graph  treatment  for 
any  types  of  questions,  but  had  lower  scores  for  the  amount  and  static  questions 
when  compared  to  the  table  treatment.  The  bar  graph  scores  did  not  differ  from  the 
table  for  dynamic  questions.  The  relatively  poor  performance  of  the  bar  group  on  the 
static  questions  also  merits  additional  work.  Future  studies  of  this  type  should 
increase  the  amount  of  data  in  the  table  and  decrease  the  time  of  each  trial.  Both 
of  these  conditions  would  provide  a  better  approximation  to  conditions  in  a 
classroom  or  business  meeting. 

This  study  partially  confirmed  the  resuMs  of  Benbasat  and  Dexter  (1966)  in  that 
tabular  reports  were  better  than  graphical  formats,  but  did  not  find  that  combined 
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Table  1 .  Mean  Raw  Scoie  as  a  Function  of 

Type  of  Graph  and  Type  of  Question 


1  

Graph  Type 

Type  of  Question 

Mean 

Amount 

Static 

1  Dynamic 

Une 

12.67 

12.83 

10.63 

12.04 

Bar 

12.83 

12.96 

11.58 

12.46 

Table 

13.63 

13.67 

12.29 

13.19 

Line-Table 

13.54 

13.00 

12.29 

12.94 

Mean 

13.17 

13.12 

11.70 

12.66 
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Table  2.  Mean  Percent  Score  as  a  Function  of 
Type  of  Graph  and  Type  of  Question 


Graph  Type 

Type  of  Question 

Mean 

A-nount 

Static 

Dynamic 

Une 

90.50 

91.64 

75.93 

86.00 

Bar 

91.64 

92.57 

82.71 

89.00 

Table 

97.36 

97.64 

87.78 

94.21 

Une-Tabie 

96.71 

92.86 

87.78 

92.43 

Mean 

94.07 

93.71 

83.57  j 

90.43 

Tab'e  3.  Summary  of  AnaVsis  of  Variance 


Source 

df 

SS 

MS 

F 

n 

K 

Between  subjects 

G  (TypeofGrKpti) 

3 

56.85 

18.95 

4.71 

<  0,005 

Subjects  w.  groups 

92 

369.81 

4.02 

Within  subjects 

Q  (Type  of  Question) 

2 

133.34 

66.67 

46.56 

^  0.001 

GXQ 

6 

15.22 

2.54 

1.78 

n.s. 

Q  X  subjocts  w.  groups 

184 

263.44 

1.43 
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Figure  1 .  Percentage  Correct  Responses  as  a  Function  of  Chart  Type  and  Type  of  Question 


Correct  Responses  (%) 


70 

Amc  -nt  statto  Dynamic 

Type  of  Question 
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tabular  and  graphical  (line-table)  were  superior  to  table  in  terms  of  performance. 
However,  the  Ss  in  Benbasat  and  Dexter  (1966)  did  have  much  larger  data  sets  to 
interpret  which  would  favor  the  combined  format. 

study  did  not  produce  much  indication  that  there  Is  a  strong  relationship 
between  field  dependent/independence  and  the  scores  on  the  different  types  of 
questions.  However,  it  does  not  preclude  the  future  investigation  of  cognitive  style 
and  the  type  of  graphic  presentation. 

The  preliminary  nature  of  this  study  does  not  lend  itself  to  conclusions  which  can 
be  readily  translated  into  specific  recommendations  for  selecting  graphic  formats  for 
business  or  educational  environments.  However,  it  does  provide  a  basis  for 
additional  work  which  might  lead  to  such  practical  applications. 
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Abstnct 

When  education  (teaching  and/or  learning)  is  considered  to  be  an  art, 
then  it  seems  obvious  that  the  methods  of  artistic  inquiry  would  be 
appropriate  iinalysis  techniques.  Such  analysis  seems  rare  or  non-existent  in 
educational  technology.  Semiotics,  the  theory  of  signs,  provides  one  such  set 
of  methodologies  for  examining  text.  This  presentation  will  explore  the 
products  and  processes  Gt  educational  technology  as  text  using  a  variety  of 
semiotic  critical  methods. 

Semiotics  is  often  divided  into  syntactics,  semantics  and  pragmatics. 
Semiotic  criticism  can  be  based  on  just  one  or  two  of  these  divisions  or  it  can 
include  all  three.  Syntactic  criticism  focuses  on  the  structures  of  the  work. 
These  structures  can  be  assessed  simply  in  terms  of  the  evolution  of 
structural  form  (and  the  possibility  of  revolutionary  change  in  form)  or  the 
forms  can  be  evaluated  in  relation  to  the  use  of  the  work.  Semantic  criticism 
stresses  meaning  manifest  in  the  work.  While  semantics  are  normally 
applied  to  textual  materials,  critics  have  also  used  semantics  as  a  formal 
approach  to  visual  hter acy  concepts.  Pragmatics  link  antecedents  (causes), 
features  of  the  work,  and  results.  Such  inquiry  can  address  unintended  or 
unanticipated  effects  a  work  might  have  on  its  audience. 


181 


1/29/89 


SEMIOTICS  3 


iBtrodQction 

THERE  IS  AN  EXCITING  DEBATE  which  appears  to  be  just  peaking 
within  the  field  of  educational  technology.  Our  focus  of  research  questions  is 
broadening  out.  We  are  moving  from  questions  of  "how?"  to  questions  of 
"why?"  We  are  moving  from  a  search  fw  a  single  interpretation  of  reality 
and  truth,  towards  multiple  and  simultaneous  interpretations.  We  are 
moving  from  an  acceptance  of  strictly  scientific  modes  of  inquiry  towards  an 
acceptance  of  a  vaiiety  of  criticul  alternatives. 

Today's  sytriposium  attempts  to  recognize  some  of  these  alternative 
methodologies.  Wi^ether  our  individual  focus  is  criticism  and 
connoisseurship,  or  ieader-respons>  theory,  or  post-modernism  or  semiotics, 
our  joint  objective  is  lo  provide  new  ways  of  looking  at  old  questions,  and 
perhaps  at  new  questiiins. 

The  keyword  around  which  this  paper  will  operate  is  seniotics,  the 
study  of  signs.  While  the  term  has  been  traced  back  to  1 64 1 ,  referring 
specifically  to  "signs  and  symbols  and  the  study  of  their  use  in  conveying 
meaning  (Barnhart,  1988,  p.  982),"  semiotics  itself  has  only  recently  and 
rather  quietly  entered  the  vocabulary  and  the  consciousness  of  educational 
technologists.  Yet  its  import  is  reflected  ia  the  contemporary  literature, 
albeit  still  almost  unnoticed. 

Look  at  only  four  o(  the  the  most  recent  examples.  In  the  latest  issue 
of  Programmed  Uarnino  and  Educational  Technology  from  the  United 
Kingdom,  David  Smith  (1988)  examines  interactive  media  and  instructional 
sortware  from  a  semiotic  viewpoint.  "New  ways  of  conceptualizing  human 
interaction  are  evolving  which  are  not  predicted  on  hard  engineering 
or.odels.  (One  such  is]  a  practical  development  of  semiotic  analysis"  (p.  342). 

In  the  US,  the  Educational  r^mmunicatimis  and  Technology  Journal 
(KcMrac,  1988)  hat  recently  featured  a  paper  suggesting  a  semiotic  analysis  of 
audiovisual  media.  And  another  ECTJ  paper  titled  "Good  Guys  and  Bad  Guys" 
(Cunningham,  1986)  lakes  on  Richard  Qark  s  meta-analytic  research.  Noting 
that  educational  technologist's  elusive  goal  is  to  discover  once  and  for  all 
vhich  method/ medium  is  best,  which  is  the  good  guy,  and  which  is  the  bad 
guy.",  Cunningham  argues  for  a  constructivist  and  semiotic  approach  to 
educational  research,  so  that  knowledge  is  seen  as  being  constructed  rather 
than  discovered.  Then,  "if  we  come  to  understand  the  constructive  *"»-ure  of 
our  knowledge,  we  cap  make  more  modest,  context-dependent  claims  about 
'the  truth  of  the  matter'  and  be  less  embarrassed  when  we  are  wrong.  In 
other  words,  there  are  no  good  guys  and  bad  guys,  onl^'  guys  "(p.  7). 

A  fourth  example  is  a  just  released  book  by  MarshaU  &  Eric  McLuhan 
(1988).  Titled  Laws  of  Media  the  study  presents  four  "laws",  provides  a 
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Structural  analysis  of  selected  media,  and  concludes  with  a  suggestion  for  a 
focus  on  media  poetics  (that  is,  the  systematic  study  of  media  as  literature): 
As  the  information  which  constitutes  the 
environment  b  perpetually  in  flux,  so  the  need  is 
not  for  fixed  concepts,  but  rather  for  the  ancient 
skiU  of  reading  that  book,  for  navigatins  through 
an  ever  uncharted  and  unchartable  milieu.  Else  we 
will  have  no  more  control  of  this  technology  and 
environment  than  we  have  of  the  wind  and  the 
tides,  (p.  239) 

The  above  xamples  should  at  the  very  least  serve  to  point  out  that 
interest  in  semiotics  is  not  an  isolated  one.  It  seems  safe  to  suggest  that 
semiotics  is  entering  the  vocabulary  and  the  modes  of  inquiry  of  educational 
technologists.  Ye*  what  is  semiotics?  The  term  seems  to  be  not  well  known 
and  writers  seem  to  rue  immediately  into  problems  of  definition.  "Education 
is  a  field  in  which  semiotics  has  had  relatively  little  impact"  (Cunningham. 
1987). 


Wlm  is  ftmiolics? 

Semiotics  is  the  study  of  signs  and  sign  systems  of  all  kinds.  It 
involves  the  production  of  signs,  communication  through  signs;  the 
systematic  structuring  of  signs  into  codes;  the  social  function  of  signs,  and 
finally,  the  meaning  of  signs.  The  fi;  t  important  insight  which  semiotics 
provides  is  that  signs  and  sign  systems  are  arbitrary  and  culturally  bound. 
The  second  important  insight  from  semiotics,  which  foUows  the  first,  is  that 
linguistic  concepts  can  be  used  to  analyze  far  more  than  merely  linguistic 
texts,  but  all  texts,  where  a  text  is  anything  to  be  read,  in  the  broadest  sense. 

Robert  Scholes(  1 982):  "semiotics  has  in  fact  become  the  study  of 
codes:  the  systems  that  enable  human  beings  to  perceive  certain  events  or 
entities  as  signs  bearing  meaning...As  an  emerging  field  or  discipline  in 
liberal  education,  semiotics  situates  itself  on  the  uneasy  border  between  the 
humanities  and  the  social  sciences...As  the  study  of  codes  and  media, 
semiotics  must  take  an  interest  in  ideology,  in  socioeconomic  structures,  in 
psychoanalysis,  in  poetics  and  in  the  theory  of  discourse  (p  ix-x).  If 
semiotics  is  concerned  with  signs,  then  it  is  equally  concerned  with  meaning. 
Ultimately,  semiotics  is  the  study  of  meaning,  meaning  systems,  and  the 
origination  and  generation  of  meaning.  These  meanings  are  grounded  in 
text  and  discourse.  ' 

David  Sless  (1986):  "Semiotics  is  above  all  an  inteUectual  curiosity 
about  the  ways  we  represent  our  world  to  ourselves  and  each  other"  (p.  1 ). 
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"Semiotics  studies  messages  and  in  order  to  study  messages  we  have  to  read 
them.  A  reader  is  always  a  participant,  never  an  observer"  (p.  30) . 

Umber  to  Eco(  1 976 ):  "Semiotics  is  concerned  with  everything  that  can 
be  taken  as  a  sign.  A  sign  is  everything  which  can  be  taicen  as  significantly 
substituting  for  something  else  .  semiotics  is  in  principle  the  discipline 
studying  everything  which  can  be  used  in  order  to  lie"  (p.  7). 

Whsra  do  mniotic  itndiflf    vittdn  the  adncttiooal  technolo^ 

endeiTOr? 

Educational  technology,  most  often  described  as  a  "systematic 
approach"  to  teaching  and  learning,  is  inevitably  involved  with 
communication,  signs,  codes,  and  meaning.  Therefore,  it  would  seem  that 
semiotics  should  be  a  compatible  and  parallel  field  from  which  educational 
technology  might  benefit.  There  is  a  major  tradition  in  education,  ultimately 
overlapping  with  educauonal  technology,  into  wliich  a  semiological  approach 
seems  especially  appropriate,  namely  curriculum  theory.  It  is  this  tradition 
which  provides  a  potential  coupling  of  educational  technology  and  semiotics. 

Schubert  ( 1 988 ),  borrowing  from  Haber mas(  1 97 1 ),  identifies 
curriculuir.  as  operating  within  three  alternative  paradigms.  The  dominant 
curriculum  paradigm  is  the  "technical"  (Habermas:  empirical-analytic).  A 
second  paradigm  for  curriculum  inquiry  is  the  "situational  interpretive" 
(Habermas:  Historical-hermeneutic).  The  third  paradigm  is  identified  as 
"critical  theoretic"  (Habermas:  critical  theory).  Aoki  (1986)  describes  the 
focus  of  interest  in  each:  In  the  technical  or  means-ends  model,  "interest  is 
in  the  ethos  of  control  as  reflected  in  the  values  of  efficiency,  effectiveness, 
certainty  and  prediaability.  In  the  situational-interpretive  or  practical 
paradigm,  interest  focuses  on  "the  meaning  struaure  of  intersubjective 
communication  between  and  among  people  who  dwell  within  a  situation."  In 
the  critical-theoretic  mode,  interest  is  "emancipation  from  hidden 
assumptions  or  underlying  human  conditions." 

This  technical/practical/  critical  trichotomy  is  useful  in  locating  what  is 
taking  place  in  educational  praxis.  Educational  technology  with  a  penchant 
for  better  task  analysis  techniques  and  more  precise  behavioral  objectives, 
not  to  mt^ntion  a  concentration  on  the  neit  new  medium  just  around  the 
corner,  falls  squarely  within  the  technical  orientation. 

Within  curriculun  theory  there  is  also  a  readily  identified  "practical" 
dimension  of  curriculum  exemplified  in  the  writings  of  Joseph  Schwab 
( 1973).  Schwab  c  well  known  commonplaces  are  the  teacher,  the  learner,  the 
milieu,  and  the  subject  matter.  "Defensible  educational  thought  must  take 
account  of  the  four  comm.mplaces  of  equal  r ank...None  of  these  can  be 
omitted  without  omitting  a  vital  factor  in  educational  thought  and  practice." 
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When  one  eiamines  the  AECT  "official"  definition  of  educational  technology 
side  by  side  with  these  four  commonplaces,  the  similarity  becomes  apparent: 
Educational  technology  is  a  complei,  integrated 
process  involving  people,  procedures,  ideas, 
devices,  and  organization  for  analyzing  problems, 
and  devising,  implementing,  evaluating,  and 
managing  solutions  to  those  problems  (AECT, 
1977). 

The  juxtaposition  of  the  two  definitions  is  additionally  significant, 
since  it  illustrates  that  educational  technology  is  not  locked  into  the 
technological  paradigm,  but  indeed  has  apparently  endorsed  this  second 
significant  alternative  paradigm.  SucL  a  positioning  of  educational 
technology  shows  that  the  discourse  of  the  field  is  not  as  one-sided  and 
single-minded  as  some  would  have  us  believe. 

Semiotic,  connoisseurship,  and  post- modem  approaches  fall  within  the 
third  paradigm,  the  critical.  Within  this  third  paradigm  "the  object  tl  the 
critic ...  is  to  seek  not  the  unity  of  the  work,  but  the  multiplicity  and 
diversity  of  its  possible  meanings,  its  incompleteness,  the  omissions  which  it 
displays  but  cannot  describe,  and  above  aU,  its  contradictions"  (Belsey,  1980, 
p.  109).  It  has  not  normaUy  been  the  concern  of  educational  technology  to 
focus  on  this  domain.  The  role  of  the  technologist  is  to  implement  someone 
else's  objectives.  As  recent  a  text  as  Knirk  and  Gustafson  (1986)  is  clear  on 
this  point:  "Although  an  instructional  technologist  may  have  a  voice  in 
creating  policy,  he  or  she  is  primarily  responsible  for  JmpJementJng  policy 
decisions... If  an  instructional  technologist  questions  the  goals,  an 
interpretation  should  be  provided  by  a  representative  of  the  policy  making 
body  "  (p.  33,  emphasis  mine).  Such  a  stateme-»t  clearly  places  educational 
technology  as  overlapping  the  technical  and  practical  dimensions  as 
identified  above,  but  outside  the  critical  dimension. 

Yet  today's  symposium  argues  precisely  in  favour  of  adding  this  third 
paradigm  to  the  discourse  of  educational  technology. 


Semiotic  qneitioiif  in  adncatioiial  technology 

This  section  will  identify  some  key  semiotic  concepts  which  appear  to 
hold  particular  promise  for  educational  technology.  Time  and  space  permit 
not  much  more  than  a  mere  listing  of  areas  ripe  for  exploration. 
1.  The  concept  of  sign.  The  nature  of  the  interaaion  between  signifier 
and  signified  (from  Saussure),  and  the  importance  of  semiosis  and  the 
interpretant  (from  Peirce)  provide  starting  points  for  an  examination  of 
meaning  of  and  within  educational  produas. 
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2.  Structure  of  educationtl  media  at  constructed  "teit".  A  variety 
of  methodologies  exist  which  have  been  used  to  explicate  underlying 
structure  in  literature,  poetry  and  film.  Such  techniques  need  to  be  applied 
to  educational  media  and  technology. 

3.  The  role  of  the  reader.  Reader  response  theory  extends  semiotics  by 
focusing  on  the  newly  re-discovered  importance  of  the  reader  in  the  triadic 
relationship  between  the  author,  the  text,  and  the  reader. 

4.  The  Rhizoae.  The  rhizomatic  (rhizome  -  tuber,  plant  root  which  is  at 
once  root,  stem,  bulb,  conneas  ail  parts  of  the  plant  to  all  other  parts) 
metaphor  of  Umberto  Eco  (1984)  provides  a  useful  extension  and/or 
alternative  to  the  cognitive  view  of  learning. 

5.  Syntagaatic  and  paradsgv.atic  analyses.  Paradigmatic  and 
syntagmatic  analyses  require  the  reader  to  examine  the  structure  of  texts  in 
terms  of  its  horizontal  and  vertical  dimensions.  Sophisticated  insights  into 
the  nature  of  media,  technology,  and  mass  culture  have  resulted  from  such 
analyses  in  a  variety  of  fields  from  literary  criticism  lo  sociology. 

At  this  point  it  is  appropriate  to  turn  to  an  example  which  is 
illustrative  how  semiotics  can  inform  the  role  of  the  instructional  developer. 


The  case  of  the  linp  french  fries. 

A  few  years  ago,  I  attended  a  convention  on  instructional 
development.  I  remember  a  session  in  which  the  speaker  was  talking  about 
how  she  had  identified  a  training  problem  and  developed  an  appropriate 
solution.  The  problem  area  was  restaurant  management.  A  problem  had 
developed  in  some  of  the  restaurants  which  %ere  producing  "limp"  french 
fries.  This  was  diagnosed  as  a  training  problem.  There  were,  as  you  can 
imagine  a  variety  of  potential  solutions.  Perhaps  the  potatoes  were  not  kept 
long  enough  in  the  fat.  Perhaps  they  were  too  thick,  so  could  not  crisp 
properly.  Perhaps  they  were  allowed  to  "drip  dry"  too  long;  or  perhaps  it 
was  not  long  enough.  The  ultimate  cause  is  not  important  here.  What  is 
important  is  that  a  systematic,  positivistic  model  allows  one  to  identify  the 
proble^'i,  examine  alternative  potential  causes,  and  develop  an  appropriate 
solution.  U    turns  out  that  the  solution  is  not  the  right  one,  we  recycle. 
BventuaUy,  through  trial  and  error,  through  test  and  retest,  through  constant 
monitoring,  the  problem  will  be  solved. 

So  Where's  the  debate?  I  like  Ump  french  fries.  In  fact,  where  I  come 
froDi,  Winnipeg,  Manitoba,  where  the  winter  wind  chill  temperature  can 
exceed  40  below,  the  hot,  thick,  greasy,  and  yes,  "Ump  french  fry,  is  the  aa/y 
french  fry.  A  limp  french  fry  means  real  potatoes  were  used,  not  the  re- 
constituted kind.  A  limp  french  fry  means  freshly  cut  potatoes;  not  the  kind 
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you  buy  pre-cut.  pre-packaged:  pre-formed.  A  limp  french  fry  impUes  only 
potato;  no  unneces.tary  and  unhealthy  additives  to  guarantee  a  false  and 
unnatural  crust  in  short,  the  only  french  fry  is  a  limp  french  fry. 

There  is  more.  If  by  chance,  the  french  fries  come  out  crisp  (heaven 
forbid),  we  have  a  variety  of  ways  to  make  them  limp  again.  Americans  add 
ketchup.  Canadians  add  white  vinegar.  And  in  Winnipeg,  an  especially 
popular  solution  is  to  serve  french  fries  with  gravy.  Then  they  have  to  be 
limpi 

***««««« 

What  I  have  just  presented  you  with  is  a  rather  simplistic  example  of 
deoonttruction.  usually  credited  to  Jacques  Derrida  (1976). 
Deconstruction  is  intended  to  be  an  astute  and  careful  reading  of  a  text  such 
that  the  apparent  meaning  breaks  down,  and  reverses  itself  when  subjected 
to  close  scrutiny.  Deconstruction  is  at  the  heart  of  the  post-modern 
enterprise.  It  is  carrying  the  semiotic  project  to  its  limit. 

Look  what  our  analysis  has  done.  By  identifying  a  problem,  we  note  a 
series  of  binary  oppositions:  limp/crisp;  bad/good;  unacceptable/accepuble. 
Second,  we  see  that  the  concept  "crisp"  is  unintentionally  "valorized"  as  being 
the  ultimate  quality.  Once  we  recognize  that,  we  can  reverse  the 
valorization.  The  result  is  a  displacement,  and  a  re-ordering  of  values.  The 
original  meaning  crumbles.  (Interestingly,  in  this  process,  the  new  reading 
itself  is  equally  susceptible  to  a  deconstructionist  reading.) 

What  are  the  implications  for  curriculum?  What  are  the  implications 
for  educational  technology?  The  basic  questions  of  what  to  teach  and  why 
and  how  are  increasingly  subject  to  deconstructionist  readings.  Why? 
Because  the "  post-modern  turn"  no  longer  allows  a  complacent,  linear  view 
of  how  things  work.  The  post-modern  view  is  an  all-at-once  view,  a 
discontinuous,  intermittent  view,  a  view  commensurate  with  a  multi-cultural 
society.  The  traditional  subject  is  de-centered.  And  most  important,  we  are 
allowed  to  question  the  very  ground  on  which  we  stand.  We  are  not  only 
allowed,  but  encouraged  to  ask  "Why?" 

But  I  am  getting  ahead  of  myself.  I  have  moved  into  the  areas  of 
post-semiotics,  or  post-structuralism,  or  post-modernism. 

Let  us  return  to  the  case  of  the  limp  french  fries.  Our  purpose  will  be 
to  unpack  the  text  and  to  uncover  the  structural  ambiguity  which  is  inherent 
in  the  process  of  reading,  interpretation  and  understanding.  For  educational 
technologists,  such  a  task  is  paramount  Following  the  schema  of 
Sless(1986),  we  begin  by  rtxalling  the  author  -  text  -  reader  paradigm.  In 
fact,  there  are  two  types  of  texts.  The  author/text  is  the  text  generated  by 
and  understood  by  the  author.  The  reader/text  is  the  text  generated  by  the 
reader  in  his  search  to  make  sense  of  the  author/text. 

We  can  horizontally  represent  my  role  as  reader  of  the  story  of  the 
limp  french  fries  as  R 1 .  This  reader  is  directly  linked  to  the  instructional 
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developer  who  authored  the  ID  report.  Let  us  call  this  individual  A2. 
Schematically  we  have: 

Rl  A2 

However  A2,  before  becoming  and  author,  was  a  reader,  which  can  be 
designated  R2.  It  was  this  reader  who  noted  and  identified  the  problem  of 
the  "limp  french  fries,  identifoed  as  P.  Now  we  have 

Rl  A2/R2  P 

Returning  to  the  beginning  of  the  scheme,  we  see  a  missing  step.  I  am 
no  longer  a  reader  Rl  of  this  story;  but  in  telling  it  to  you,  I  am  an  author. 
The  current  reader  is  you,  RO: 


RO  Al 

This 
Presentation 


Rl  A2 

Instructional 
Developer 


R2  

'^oduct 


ERIC 


What  we  have  produced  is  the  first  stage  of  a  schematic 
representation  of  the  story  of  the  limp  french  fries  as  it  moves  from  a 
variety  of  perspectives  and  interpretations.  To  summarize: 
RO  is  you  as  reader  of  this  presentation,  here  and  now, 
Al  represents  me  as  author  of  this  presentation, 
Rl  represents  me  as  reader  of  the  "limp  french  fries"  story, 
A2  represents  the  instructional  developer  as  author, 
R2  represents  the  instructional  developer  as  reader  of  the  situation,  and 
P  represents  the  situation,  as  read  by  the  instructional  developer. 

Of  course,  one  might  increase  the  level  of  complexity,  as  well  as  the 
length  of  the  horizontal  displacment,  but  that  is  unnecessary  at  this  stage. 
The  purpose  of  such  an  exercise  is  to  highlight  the  constructed  nature  of 
reality  leading  to  a  clearer  understanding  of  the  social  interactions  involved. 
In  addition,  the  technique  attempts  to  identify  the  layers  through  which  the 
reader /author  dichotomy  has  moved. 

One  additional  comment  will  serve  to  round  off  this  analysis.  First,  the 
model  brings  out  an  intriguing  comparison  with  our  penchant  to  model  the 
human  mind  on  the  computer.  There  is.  interestingly,  a  computer  version  of 
this  activity  which  I  have  just  described.  Whenever  one  wishes  to  copy  a 
file  onto  a  backup  disc,  one  goes  through  a  process  in  which  the  computer 
reads  the  file,  then  copies  *x  writes  that  file  onto  the  new  disc.  While  this  is 
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happening,  the  computer  screen  presents  a  message  which  typically  says 
"reading"  during  the  first  phase,  then  "writing"  during  the  copying  r  se. 
These  terms,  reading/writing  alternative  until  the  entire  file  is  copied. 

The  situation  is  analogous  to  the  reader /author  interaction  described 
above.  However  the  difference  is  significant.  In  liie  computer  model,  the 
computer '  reads '  everything,  literally,  then  "writes"  everything.  What 
makes  humans  special  is  that  we  read  selectively  as  we  are  simultaneously 
influenced  by  a  host  of  environmental  and  social  factors;  then  we  write,  also 
selectively.  Semiotics  brings  out  clearly  the  very  human  characteristics  and 
the  constructed  characteristics  of  message  and  meaning  analysis. 


Conclusion 

In  this  paper,  I  have  tried  to  highlight  some  dimensions  of  applying 
semiotic  techniques  to  educational  technology.  Semiotics  produces 
techniques  for  reading  texts.  As  educational  technology  becomes  more 
sophisticated,  we  need  to  familiarize  ourselves  with  the  complex  relation  of 
text  to  author  to  reader.  As  educational  technologists  we  are  all  three. 

Yet  our  road  to  improve  communications  is  a  thorny  one.  Douglas 
Adams  said  it  with  sarcasm  in  The  Hitchhiker's  Guide  to  the  r.alaTy ,  but  his 
warning  is  not  to  be  taken  lightly. 

...if  you  stick  a  Babel  fish  in  your  ear  you  can 
instantly  understand  anything  said  to  you  in  any 
form  of  language...lTJhe  poor  Babel  fish,  by 
effeaively  removing  all  barriers  to  communication 
between  different  races  and  cultures,  has  caused 
more  and  bloodier  wars  than  anything  else  in  the 
history  of  creation,  (p.  50) 
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PERCEPTIONS     OF       INTERNPTIONPL       STUDENTS       TOWftRD  THE 
OF  EDUCPTIONPL  MEDiP   IN  THEIR  HOME  COUNTRIES 


US^ 


INTRODUCTION 

The  purpose  of  this  study  was  to  examine  the  perceptions  of 
international  students  toward  the  use  of  educational  media  in 
their  home  countries. 

b'very  year  thr-usands  of  international  students  come  to  the 
United  Stat  es  for  h  ighpr  »3ducat  ion  and  edvanced  training.  The 
majority  of  these  scudentsr  upon  their  return,  are  expected  to 
hold  leadership  positions  in  education,  business  &  industry, 
and  government.  Ps  leaders  they  are  expected  to  play  the  roles 
of  planners,  advisors,  decision  maners,  change  agents,  and 
administrators.  PI so  these  people  are  1 i kely  to  be  involved  in 
the  procers  of  transfer  of  technology,  or  adoption-diffusion 
process  of  innovations   in  their  home  countries. 

Claudine  Michel  (1987)  has  also  highlighted  the  importance  of 
international  students  in  the  process  of  transfer  of  technology 
or  adoption-diffusion  proc€?ss  of  innovations  in  their  home 
countries.  There  are  three  groups  of  people  involved  in 
such  processes.  The  First  group  includes  members  of  a  foreign 
nation  like  educators  and  business  representatives  who  try"* 
to  convince  the  decision-makers  of  a  country  to  adopt  the  new 
technology.  The  Second  group  cq^nprises  those  individuals  in  a 
country  who  are  assigned  the  task  of  solving  educational 
problems.  The  third  group  is  the  well  familiar  group  of 
international  students  irj  various  U.S.  colleges  and  uni  versi  t  lest 
It  is  the  members  of  the  third  group  that  comes  into  short  or 
long-term  contact  with  the  tiost  recent  educational  media  when 
they  enter  European  of  Pmerican  universities.  In  some  cases  they 
become  not  only  acquainted  with  the  new  educational  media,  but 
also  adequately  experienced  in  using  some  of  them.  Ulhen  these 
international  students  return  home,  they  take  with  them 
not  only  their  increeased  knowledge,  skills,  and  experience,  but 
also  their  perceptions  and  attitudes  toward  educational 
media.  They  go  home  to  assume  positions  in  teaching, government , 
educat lonal   administ rat  ion,    and     business  &  industry. 

Rogers  and  Shoemakers  (1971)  have  listed  a  large  number  of 
studies  indicating  that  favorable  perceptions  are  positively 
related  with  adoption-diffusion  of  innovations.  Therefore,  the 
perception  of  international  students  toward  the  use  of 
educational  media  in  their  home  countries  is  one  of  the 
critical  factors  that  needs  to  be  considered  by  those 
interested  in  introducing  new  educational  technology,  or  in 
expansion  of  markets  for  various  educat  ional  med  ia  in 
developing  count r ies. 

RESEPRCH  QUESTIONS 

Based  on  the  foregoing  facts,    this  study  was  designed     to  answer 
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the  following  questions: 


(1)  What  is  the  nature 
internat  ional  st  udents' 
use     of     educational  media 


(positive       or       negative)  of 
general     perception     toward  the 
h  orne       co  u  nt  r  i  es 


in  their 


What    IS  the     level  internc.t  ional     students'  general 

perception  toward  the  use  of  educational  media  in  their 
home  count r  i  es 

(3)  What  IS  the  level  of  international  students' 
perceptions  toward  the  use  of  educational  media  in 
re  1  at  ion  to  educat  ional  inst  it  ut  ions,  business  Be 
industry,    and  government  ? 

(4)  Do  the  general  as  well  as  specific  perceptions  of 
i  nt  er nat i ona 1  st  udent  s  t  oward  t  he  use  o  f  educat i ona 1 
media  vary  in  terms  of  levels  of  their  academic 
programs,  experience  with  media,  information  about 
med ia,    and  annua  1   per  capit a  i ncomes  ? 

DEFINITIONS  AND  DESCRIPTIONS  OF  TERMS 


For  clarity  and  better  understanding,    definitions  and 
descriptions  of  some  basic  terns     and     expressions  used 
study  are  given  below; 


in  the 


International  Students?  The  term  international  students 
refers  to  students  from  developing  countries  enrolled  m 
different   programs   in  Fall   198f     at     Michigan     State  University, 


Home     Count  ries :         They       refer  to 
international   students  will     return  after 
education     and     training     in     U.S.A.  for 


countries       to       wh ich 
complet  ion     of  their 
permanent     set  t 1 ement . 


Educational  Media:  This  term  refers  to  those  media  which 
are  used  in  teaching,  learning,  and  training  environments  as 
instructional  aids.  For  example,  pictures,  films,  slides,  audio 
and  video  ^ apes,  computers,  interactive  video  and  thfc  liUe,  It 
does  noi  i nc 1 ude  pr i nt ed  books  and  b 1 ackboards  wh i ch  are  the 
basic  educat  ional  med  ia  used   in  developing  countries. 

Use  of  Educat  iona 1  Med  ia :  It  refers  to  the  perceived 
practice  of  educational  media  in  teaching,  learning,  training, 
and   information  processing  environments. 


Nature     of     Perception:  This 
perception  of  internat  ional  students 
negat  i ve   (unfavorable) . 


term  means 
is  positive 


whether 
( favorable) 


the 


Levels  of  Percept  ions  It  refers  to  high, 
levels  of  respondents'  perception. 


medium,     and  low 


Levels  of  Pcademic  Programs:  This  term  refers  to 
undergraauate  or  graduate  status  of  the  respondents  enrolled  m 
Fall  1989  at  Michigan  State  University. 
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Levels  of  Experxence:  This  term  poynts  out  to  the  degree  of 
actual  interactions  of  the  respondents  with  various  educational 
media  as  teaching,    learning,    or  training  tools. 

Levels  of  Information:  It  refers  to  the  respondents  degree 
of  simple  knowledge  of  various  educational  media,  e.g.,  what 
are  they  ?     What  do  they  do         What   they  are     used     for     ?  etc. 

Pnnual  Per  Capita  Income:  This  expression  means  the  a^inual 
per  capita  income  of  the  people  in  respondents'  home  countries 
as  reported   in  the  1988  Plmanac. 


f*1ETH0D0L0GY 


POPULPTION  PND  SftMPLE 


The  study  used  a  cross-sectional  survey  method.  The 
population  for  this  study  consisted  of  all  international 
students  enrolled  in  Fall  1SB9  at  Mighigan  State  University. 
These  international  students  included  students  only  from 
developing  countries  of  Asia,  flfr-.ca,  Latin  America  and 
Caribbean.       P     total       of       £9       countries       were  represented. 

By  using  random  sampling  technique,    a  sample     of  35«     was  drawn 

for  this  *3tudy.     Out  of  this     ^150     int e»-nat  ional  students,  only 

508  returned  the  completed  questionnaires.      The  rate     of  return 

was            which  was  considered  adequate     for     the  data  analysis. 

DATA  COLLECTION 


The  data  were  collected  through  a  structured  questionnaire 
with  a  5-point  Likert  scale;  which  was  designed,  developed  and 
tested  for  this  study.  The  questionnaires  were  mailed  to  the 
respondents  with  cover  letters,  and  two  weeks  were  allowed  for 
the  return  of  the  completed  questionnaires.  Those  who  did  not 
return  the  questionnaires  within  a  twO"-week  period,  were  once 
more  requested  through  telephone  calls  to  return  the  completed 
quest  ionnaires  within  a  week' s  t  ime.  These  efforts  helped 
collect  2(58  completed  questionnaires  which  formed  the  basis  for 
the  dat3  analysis. 


DATA  ANALYSIS 


To  analyze  the  data  frequencies,  percentages,  means  and 
analysis  of  variance  were  used.     The  data  were    analyzed     by  the 

computer  using  SPSSX. 
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W«anS  ¥»mrm  computed  to  find  the   levels  of  qeneral  perception 
the  respondents,   and  also  to  compare  the     levels     of     percept icns 
toward  the  use  of  educational     media     in     education,      business  ^ 
industry,     and     government.  To       determine*       the       ic?yels       r  r 

perceptions  mean  scores  were  collasped     as     follows:     meanE  over 
4  to  5  =  high   level?   means  3  to     4     =     medium     level:      and  me.-^ 
below  3  =  low  level. 

Pnal  ysi  5  of  wariancB     was     Milled     to     eHamine     the     var  lat  i  :.n*^>      i  r 
perceptions  due  to  academic     programs.      t?vperience,      irtform-iit  lO'' , 
and  annual   per  cap  it  a  incomes   i  n     respondent  s'        hornp     count  r  i 
Schef  f  e     post     hoc     t  est     was     a  1  so     run       to       f  i  nd       wH  i  ch       o  f 
the     two     parts     of     a     group       Wc-re       significantly       ci  i  f  f  er '•^n*  .. 
Pcademic  programs  were  indicated  bv  undergraduate     and     qraduat  .s 
and  the   levels  of  experience  and   i nf c >"inat  ion     were     pxpressprJ  : 
high,    medium  and   low     based     on     their     respective     mean  score-s. 
Mean  scores  were  coll  lapsed  as  follows:     Mean  scores     of     1 .  ciS  to 
2.99  =5  low  level;   3  to  4  =  medium  level;   and  4.01     to     5     «  high 
level.      The  high    (above     *liZi,  i20i3) ,     medium  to     *H?,  ^00^, 

and   low     ('below  levels     of     annual     per     capita  incomes 

were  determined     on     the     basis     of     annual     per     capita  incomes 
reported   in  the  1988  Plmanac     for     respondents'      home  countries. 
The  questionnaire  used  a  5-point   Likert     scale     and     the  weights 
were  assigned     as     follows:      Strongly     Pgree     =     5;      Pgree  = 
Neutral   ==  3;   Disagree  =       ;     aid     Strongly     Disagree     =     1.  For 
item     numbers     6,      7,      IS       and        13       weights       were  .reversed. 

VPRIPBLES 

For  this  study,  the  independent  variables  were  ^"esponde^'t <=: ' 
academic  programs,  experience,  information  and  annual  per 
capita  incomes-  The  dependent  variable  was  respondent ' 
perceived  use  of     educational     media     m     their     home  countrie^^. 


FINDINGS  OF  THE  STUDY 
The  findings  of  the  study  are  presented  below: 
NATURE  «ND  LEVELS  OF  PERCEPTIONS 

The  findings  of  the  study   in'-'icate  that   the     general     percept  i-' 
of  the  respondents     toward     the     use     of     educat  lonal     med  i a  w^'-^ 
positive  in  nature  and  were  expressed  at   a  high     level      ( y==4.  «39  « 

The     data     were     further     analyzed       to       see       the       levels  r,f 
respondents'    perceptions  towai^d  the  use  of  educat  iori«:?il     media  in 
educat  ion,    business  8t       industry,      and     government.  "Respondent 
indicated     a     higher     level     of     positive     perceptions       (><^4-  r5) 
toward  the  use  of     educational     media     in     business     8(  industry, 
followed     by     government      (x«4.  14),        and       education  (k^-4.04'. 
Table  1  contains  the  data. 
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VflRIPTIOIMS  IN  PERCEPTIONS 


P  significant  difference  (F  value  of  3.96  c<t  .05®  significance 
level)  in  respondents'  general  perception  was  indicated 
m  terms  of  levels  of  their  annual  per  capita  incomes. 
Scheffe  test  showed  that  respondents  with  high  and  low  levels 
of  annual  per  capita  incomes  differed  significantly.  However, 
no  significart  differences  were  noticed  in  terms  of  levels  of 
academic     programs,      experience       and       information.  Table  £ 

presents  the  data. 

Results  also  indicate  that  respondents'  specific  perceptions 
in  relation  to  education,  business  8t  industry,  and  government 
differed  significantly.  Differences  were  found  in  respondents' 
specific  perceptions  in  relation  to  education  by  levels 
of  information  (F  value  of  3.86  at  .05®  significance  level), 
and  annual  per  capita  income  (F  value  of  4.50  at  .050 
significance  level);  in  relation  to  business  &  industry  by 
levels  of  experience  (F  value  of  3.43  at  .050  significance 
level)  only;  and  in  relation  *.o  government  by  levels  of 
experience  (F  value  of  4.53  at  .05®  significance  level)  and 
levels  of  annual   per  capita  income     (F     value     of     3.21     at  .050 

MINOR  FINDINGS 

Out  of  £08  respondents,  39  were  undergraduates  and  169  were 
graduate  students.  With  regard  to  levels  of  experience,  only  3 
indicated  a  high  level  of  experience  with  educational  media,  48 
respondents  reported  medium  level  of  experience,  whereas  157 
respondents  stated  that  they  had  a  low  level  of  experience  with 
educat lonal  media. 

In  respect  of  levels  of  information  about  educational  media, 
15  respondents  said  that  they  had  a  high  level  of  information 
about  educational  media,  149  respondents  reported  their 
information  level  at  medium  level,  and  44  respondents  stated 
they  had  a  low  level     of     information     about     educational  media. 

With  regard  to  levels  of  annual  per  capita  incomes,  the  results 
showed  that  13  respondents  belonged  to  high  level  of  annual 
per  capita  income  countries,  S0  belonged  to  medium  level,  and 
135  belonged  to   low  level  of  annual   per  capita  income  countries. 

Other  minor  findings  indicate  that  the  respondents  were  from 
£9  developing  countries.  They  came  from  15  Asian  countries, 
10  Q"Frican,and  4  from  Latin    Amer'.can    and     Caribbean  countries. 

INTERPRETATIONS  AND  CONCLUSIONS 

The  high  level  of  respondents'  general  perceptions  toward  the 
use  of  educat  iona 1  med  ia  shows  a  favorable  percept  ion  of 
internat  ional  st  udents  toward  educat  ional     med  ia     in     their  home 
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Table  1 

Rank  Ortiwr  of  Perceptions  in  Relation  to 
Educat  ional   Inst  it ut ions,  Business 
it  Industry  and  Government  in 
terms  of  Mean  Sccre-, 


Categories  Rank  Number         Mean  3D 

Order 


Business  & 

Industry  i 
Government  £• 
Educat  ional 

Institutions  3 


3138  4.154  .337 

£138  4.146  .339 

£138  4.e.37  .314 


Table  2 

□ne-Way  Analysis  of  Variance  For  General 
Perceptions  in  Terms  of  Selected 
Independe  ^t  Variables 


-^^^'^if^l^f^  ^^^^  ^  Ratio      F  Prob. 

PROGRPM  LEVELS 


Undergraduates     39  4.15     .£19       £.  7i37  .101 

Graduates             169  4.  i37     .  £81 

EXPERIENCE 
LEVELS 

^^9^                           -  ?.84     .381       £.(368  .  1£9 

Medium                    48  «    i35  .347 

Low                         157  4.  11  .£41 

INFORMftTION 
LEVELS 

^^^^                          15  4.131      .356       £.874  .058 

Medium                 149  4.  l£  .£57 

Low                         AA  4.(212  .£79 

PER  CflPITft 
INCOME  LEVELS 

•^^Bh                          13  4.  £6     .151       3.956  .  0£i3  ^ 

Medium                    6i3  4.  1£     .  3i33 

^^"^^                         135  4.«G     .£613       Scheffe:High  >  Low 

♦  Significant  at  .050  level. 
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countries.  Thm  reason  for  this  high  favorable  perc  -•tion  may 
be  du»  to  respondents'  experience  with  and  informal  about 
educational  media.  This  high  level  -f  favorable  perct  ^s  of 
international  students  can  be  profitably  manipulated  favor 
of  efforts  directed  toward  introducing  new  educational 
technology  or  achieving  greater  use  of  educational  media  in 
developing  countries. 

Respondents  expressed  a  higher  level  of  perceived  use  of  media 
in  business  &  industry,  closely  followed  by  .government  in 
their  home  countries.  The  use  of  educational  media  in 
educat  ional  inst it  ut  ions  was  perceived  at  a  lower  level  by  the 
respondents.  This*  may  be  explained,  in  most  cases,  by  the 
1 imited  resources  aval lable  to  educat  ional  inst  it  ut  ions  for 
change  and  innovations.  Business  8t  industry,  and  government, 
therefore,  seem  to  be  more  potential  targets  for  introduction 
of  new  educational  technology  or  for  expansion  of  the  use  of 
educational  media  in  developing  countries. 

Respondents  from  high  annual  per  capita  income  countries 
differed  significantly  in  their  perceptions  from  respondents 
belonging  to  low  annual  per  capita  income  countries.  This 
may  be  due  to  big  difference  that  exists  in  the  annual  per 
capita  incomes  of  respondents  belonging  to  these  two  groups 
of  countries.  Countries  like  Kuwait  and  Saudi  Prabia  with 
the  annual  per  capita  incomes  of  «18, 180  and  *11,500 
respectively,  have  greater  capacity  to  introduce  new 
educational  technology  or  to  expand  the  use  of  educational 
media  in  ti  eir  schools,  business  and  government  than 
count>-ies  like  Nepal  with  an  annual  per  capita  income  of 
*  170,  or  Ethiopia  with  %  110  only.  This  leads  us  to 
conclude  that  countries  with  high  annual  per  capita  incomes 
are  better  targets  for  introduction  of  new  educational 
technology,  or  for  expansion  of  the  use  of  educational  media 
than  countries  with   low  annual   per  capita  incomes. 

The  study  is  limited  in  its  scope  and  coverage.  It  is  confined 
to  international  students  at  Michigan  State  University.  Ps  a 
result,  its  findings  can  not  be  generalised.  Plso  the  findings 
of  this  study  are  based  on  perceptual  data.  The  very  nature  of 
perceptions  being  fluid  makes  the  problem  of  measurement  elusivp. 
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Introduction 

Despite  their  increasing  numbers  in  the  work  force,  women  continue 
to  be  concentrated  in  only  20  of  the  440  occupational  classifications  listed 
by  the  Department  of  Labor.  Almost  60  percent  of  working  women  remain  in 
ow-paying,  low-skilled  Jobs  with  limited  opportunities  for  advancement 
in  1983,  only  3.4  percent  of  the  engineers  and  25.6  percent  of  the  scientists 
were  women  (U.S.  Bureau  of  the  Census,  1986). 

Cultural  sex  stereotyping  is  a  major  factor  in  guiding  women  in  their 
career  choices.  Shlnar  (1975)  asserts  that  sexual  stereotypes  of 
occupations  are  clearly  defined  and  agreed  upon  by  both  females  and  males 
Both  groups  express  greater  interest  in  careers  traditional  for  their  own 
sex  (Gregg  &  Dobson,  1980).  In  her  review  of  studies  of  occupational 
stereotypes,  Gottfredson  (1981)  found  that  people's  perceptions  of 
occupations  were  similar  regardless  of  their  sex,  age,  social  class 
educational  level,  or  ethnic  group.  Compatibility  of  a  career  with  one  s 
self-concept  is  Influenced  by  the  sextype  of  the  Job. 

A  great  deal  of  human  behavior  Is  developed  through  modeling.  New 
patterns  of  behavior  can  be  acquired  through  vicarious  experience  — 
observing  others  perform  successfully  (Bandura,  1977).  Investigators  have 
used  positive  role  models  to  change  student  attitudes  toward  careers  not 
traditional  for  their  sex.  Greene,  Sullivan,  and  Beyard-Tyler  (1982)  and 
Savenye  (1983)  provided  subjects  with  exposure  in  written  or  slide  form  to 
role  models  successful  in  nontradltional  careers.  Results  of  the  two 
studies  showed  significant  positive  change  in  student  attitudes  about  the 
appropriateness  of  careers  not  tradtlonal  for  each  sex.  Angrlst  and 
Almquist  (1975)  found  that  women  who  chose  nontradltional  careers  were 
twice  as  likely  as  women  who  chose  traditional  careers  to  state  that 
occupational  role  models  were  the  major  factor  influencing  their  choice. 

Exposure  to  sex-equitable  materials  results  in  more  flexible 
attitudes  about  sex  roles.  Schau  end  Scott  (1984)  reached  that  conclusion 
from  their  review  of  the  literature.  Ashby  and  Wittmaier  (1978)  found  that 
fourth-grade  girls  who  heard  stones  about  women  in  nontradltional 
occupations  rated  traditionally  male  Jobs  and  personal  characteristics  as 
more  appropriate  for  females  than  did  girls  who  heard  stories  about  women 
in  traditional  occupations. 

Active  participation  in  a  treatment  group  can  have  a  persuasive 
impact.  In  their  review  of  research,  Fleming  and  Levie  (1978)  found  that 
subjects  who  participated  in  role-playing  or  in  group  discussions  about  an 
issue  demonstrated  greater  attitude  changes  than  those  who  were  simply 
given  Information.  " 

Belief  in  one's  ability  to  succeed  Is  a  major  factor  in  career  choice 
Ftmalee  reported  elgnlflcently  greater  confidence  in  their  ability  to 
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perform  traditionally  female  jobs  than  traditionally  male  jobs  (Betz  & 
Hackett.  19St).  ticllahan  (1982)  found  that  college  females  had  lower 
expectations  for  success  in  cognitive  tasks  in  general  than  did  college 
males  and  that  they  rated  their  performance  to  be  lower  than  did  males. 
Junior-  and  senior-high  females  (Rosen  &  Aneshensel,  1978)  reported  lower 
expectations  with  regard  to  their  academic  achievement  than  did  males. 
Fennema  and  Sherman  (1978)  report  that  as  early  as  the  sixth  grade,  girls 
express  less  confidence  than  boys  In  their  ability  to  do  mathematics,  in 
high  school  they  perceive  mathematics  as  being  less  useful  to  them. 
Differences  between  females  and  males  In  motivation  and  achievement  in 
science  are  small,  but  consistent,  and  favor  males  (Steinkamp&  Maehr, 
1984). 

Two  career  areas  that  offer  challenge,  high  pay,  prestige,  and 
opportunity  for  professional  growth  are  science  and  engineering.  Females 
from  elementary  school  through  high  school  believe  that  science  Is  a  career 
for  themselves  as  well  as  for  boys  (Ste1nkamp&  ilaehr,  1964).  However, 
Ware,  Stockier,  and  Leserman  (1985)  found  that  women  at  the  college  level 
report  less  enjoyment  of  their  science  courses  than  males  and  abandon  their 
Interest  In  a  science  career  at  greater  rates  than  men.  Among  explanations 
offered  for  women's  failure  to  pursue  science  and  mathematics  careers  ore 
traditional  sex-role  behavior  and  their  perceptions  of  their  abilities. 

The  purpose  of  this  study  was  to  examine  the  effects  on  young  women 
of  reading  about  nontradltlonal  role  models  In  the  sciences  and  engineering, 
and  discussing  with  a  trained  instructor  various  aspects  of  participating  in 
science  and  engineering  careers.  The  dependent  variables  studied  were 
(1)  appropriateness  of  the  careers  for  both  women  and  men,  (2)  expressed 
Interest  In  the  careers,  and  (3)  subjects'  belief  In  their  ability  to  succeed  in 
the  careers.  There  were  two  treatment  conditions  (experimental  vs. 
control)  and  two  evaluation  conditions  (pretest  vs.  posttest).  To  test  for  a 
possible  generalization  effect,  subjects'  attitudes  were  assessed  both  on 
careers  Included  In  the  treatment  and  on  a  sample  of  careers  not  Included  in 
the  treatment.  A  Career  Survey  developed  from  Instruments  devised  by 
Greene  et  al.  (1982)  and  Betz  and  Hackett  (1981)  was  used  to  measure 
student  attitude.  It  was  predicted  that  attitudes  of  the  experimental  group 
would  become  more  positive  toward  the  careers  Included  in  the  treatment 
It  was  further  expected  that  the  positive  attitude  change  would  generalize 
to  the  second  set  of  science  and  engineering  careers  not  presented  during 
the  experimental  instruction. 
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f««.,.^"f^!^\^     ^'^^  eleventh-,  and  twelfth-grade 

If.Tm!«!  advanced,  elective  science  classes  (chemistry, 

qualitative  end  organic  chemistry,  physics,  and  advanced  biology)  at  a 
suburban  high  school  in  the  Phoenix  metropolitan  erea.  There  were  73 
students  in  the  experimental  group  and  80  in  the  control  group  All  female 
students  in  advanced,  elective  classes  were  Included  except  for  those  few 
in  one  class  that  met  at  a  time  when  no  other  subjects  were  available 
Subjects  had  completed  from  two  to  seven  semesters  of  study  in  both 
mathematics  and  science.  Responses  to  a  question  regarding  careers  belno 
considered  Indicated  that  nearly  all  planned  to  pursue  a  college 
undergraduate  degree  and  many  planned  advanced  study. 

Experimental  materials  prepared  for  the  study  consisted  of  an 
nstructor  guide  and  the  following  Instructional  materials:  (I)  overhead 

transparencies  presenting  facts  on  women  in  the  world  of  work 
2)  descriptions  averaging  747  words  in  length  portraying  the  career  and 

lifestyle  of  four  women  in  traditionally  male  Jobs,  and  (3)  discussion 

questions. 

Careersselectedforthestudy  were  professional  Jobs  that  require  a 
background  In  science  and/or  mathematics  and  in  which  at  leas  70  percent 
of  those  currently  employed  are  male.  To  appeal  to  a  broad  range  of 

Ir  !nrl^  ^  nl^^.^f  ^  ^'^"^  engineering,  physical  sciences,  life 

sciences,  and  health  diagnosing  practices.  One  of  the  two  careers  from  each 
occupational  group,  or  a  total  of  four  in  all,  v/as  presented  to  the  subjects 
in  the  experimental  group.  The  careers  are  listed  below 


Occupational 
 Area 

engineering 


physical  sciences 
life  sciences 


health  diagnosing 
practices 


Careers 
Presented 

Industrial  engineer 


petroleum  geologist 
forester 

optometrist 


Careers 
Not  Preeentfiri 

biomedical 
engineer 

food  chemist 

fish  and  wildlife 
biologist 

veterinarian 
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TUP  Job  descriptions  for  the  careers  presented  Information  obtained  in 
interviews  conducted  by  the  author  with  women  In  traditionally  male  Jobs. 
Standard  content  in  Job  descriptions  in  the  Occupational  Outlook  Handbool< 
(U.S.  Bureau  of  Labor  Statistics,  1964)  provided  the  basis  for  the  Interview 
questions:  nature  of  the  woric,  wori<lng  conditions,  educational  end  training 
requirements,  earnings  and  other  rewards,  and  employment  outloolc.  Other 
information  in  the  career  descriptions  Included  the  role  model's  reason(s) 
for  her  career  choice,  her  lifestyle,  and  advice  to  high  school  students 
regarding  career  search. 

The  instructor  guide  followed  accepted  instructional  design  practices 
as  described  by  Gagne  and  Briggs  (1979).  It  provided  the  Instructor  with 
the  objectives  of  the  program,  an  overview  of  the  program  to  present  to  the 
subjects,  a  motivating  activity  (facts  about  women  in  the  world  of  worl<), 
guidance  in  the  presentation  of  career  information,  and  discussion  questions 
and  suggestions  on  how  to  relate  the  information  to  the  target  audience  and 
to  enhance  generalization  of  the  information. 

The  overview  and  motivating  activity  included  data  on  numbers  of 
worlcing  women,  average  years  In  the  worl<  force,  percentages  of  worl<ing 
women  by  marital  status  and  with  children,  increasing  percentages  of 
women  in  traditionally  male  carebrs,  and  weeldy  salaries  in  relation  to  the 
percentage  of  women  in  the  Job.  Statistical  Information  was  obtained  from 
the  U.S.  Bureau  of  the  Census  (1984a,  t964b}  and  the  U.S.  Department  of 
Labor  (1984). 

The  discussion  questions  were  designed  with  two  purposes  In  mind 
The  first  was  to  relate  skills  already  possessed  by  the  students  to  those 
important  in  the  careers.  The  second  was  to  encourage  discussion  of 
solutions  to  potential  problems  encountered  in  entering  the  career. 

Criterion  Measure 

The  Career  Survey  was  constructed  to  measure  subjects'  beliefs  about 
the  appropriateness  of  the  careers  for  both  women  and  men,  their  interest, 
and  their  confidence  that  they  could  succeed  In  the  eight  careers.  Each  of 
the  eight  pages  listed  a  single  career  with  a  brief  description  of  its  major 
responsibilities  and  three  questions  to  be  answered.  The  descriptions  were 
included  so  that  both  experimental  and  control  groups  would  share  common 
l(nowledge  about  the  basic  Job  responsibilities.  All  eight  careers  were 
included  in  the  pre-  and  posttests  for  both  the  experimental  and  control 
groups.  A  sample  set  of  Items  for  one  occupation,  biomedical  engineer,  from 
the  Career  Survey  follows.  The  three  attitude  questions  were  the  same  for 
all  eight  occupations. 
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Procedures 

Teachers  of  the  science  classes  included  in  the  study  administered 
the  pretest  to  their  students  (both  female  and  male)  three  weelcs  prior  to 
the  treatment.  Males  were  included  In  order  to  not  draw  attention  to  the 
intervention.  Only  the  responses  of  the  female  students  were  analyzed.  A 
female  graduate  student  with  several  years'  experience  in  high  school 
teaching  was  trained  as  the  experimenter. 

The  study  was  conducted  during  regularly  scheduled  classes  on  two 
consecutive  days.  Female  students  were  bloclced  by  class  and  then  randomly 
assigned  to  the  treatment  or  control  group. 

The  experimental  treatment  consisted  of  the  following; 
Day  I.  (1)  Presentation  of  statistics  on  women  at  work. 

(2)  Reading  of  two  career  descriptions,  with  each  followed  by 
the  discussion  of  questions  relating  to  personal  sl<111s 
required  in  performing  the  Job  and  to  solving  problems  on 
the  job. 

Day  2:  (1)  Reading  and  discussion  of  the  remaining  two  career 
descriptions. 

(2)  Discussion  of  general  questions:  the  effect  of  sexual 
stereocypes  on  thinldng  about  a  career;  some  of  the 
barriers  and/or  probl  ims  In  entering  a  career  typically 
followed  by  men;  and  how  to  overcome  or  solve  the  above 

(3)  Posttest. 

Subjects  In  the  control  group  (and  male  students)  were  administered  the 
posttest  during  their  regular  class  time  on  Day  2  of  the  intervention  with 
the  experimental  group. 

Design  and  Data  Unm\^f\^ 

A  2  (experimental  vs  control)  x  2  (pretest  vs.  posttest)  x  6  (careers) 
factorial  design  with  three  dependent  variables  was  used.  A  multivariate 
analysis  of  variance  (MANOVA)  was  performed  to  determine  whether 
females'  attitudes  toward  traditionally  male  careers  changed  as  a  result  of 
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treatment,  and  whether  those  attitudes  generalized  to  careers  not  Included 
In  the  treatment.  Univariate  analysis  of  variance  (ANOVA)  data  for  each 
dependent  variable  are  reported  when  the  overall  MANOVA  and  the  univariate 
effects  are  both  at  or  beyond  the  .05  level  of  probability. 

fifiSillii 

The  means  and  standard  deviations  of  scores  obtained  for  each  of  the 
three  dependent  variables  for  each  of  the  eight  Jobs  by  treatment  condition 
are  shown  In  Table  1.  Item  responses  for  appropriateness  were  obtained  on 
a  three-point  scale  with  "men"  as  (1),  "women"  as  (2),  and  "both  men  and 
women"  as  (3).  The  goal  of  the  study  entailed  assessing  the  degree  of 
change  from  a  stereotypic  male-oriented  view  of  the  careers.  As  such,  the 
change  from  a  male  orientation  to  either  a  female  or  androgynous  view 
represents  the  construct  under  study.  Item  responses  for  Interest  and 
confidence  were  obtained  on  a  five-point  scale  ranging  from  "not  at  all"  (1) 
to  "very"  (5)  for  both  Interest  and  confidence. 

The  data  were  submitted  to  a  2  (treatment  conditions)  x  2  (testing 
conditions)  x  8  (careers)  mixed  multivariate  analysis  of  variance  (MANOVA) 
procedure.  This  analysis  assesses  significant  differences  due  to  the 
between-groups  factor  (treatment  condition),  the  two  within-groups 
factors  (testing  sessions  and  Job),  and  the  interaction  of  these  on  effects. 

Multivariate  and  univariate  analysis  of  variance  results  are  presented 
In  Table  2.  Results  are  reported  for  main  effects,  two-way  interactions, 
end  the  three-way  interaction  effects. 

Main  Effects 

Multivariate  analysis  of  variance  for  group  revealed  nonsignificant 
differences  between  the  experimental  and  control  groups.  Consequently, 
univariate  analyses  were  not  explored.  The  two  group  pretests  were 
similar. 

Both  MANOVA  and  ANOVA  results  showed  significant  differences  due 
to  testing  session.  Multivariate  analysis  revealed  an  overall  difference 
(a  =  .34219,  £  (3,  127)  =  81. 378,  B  <  .001.  Univariate  analyses  revealed 
differences  on  all  three  dependent  variables:  £  (1, 129)  =  182.737,  b  <  .001 
for  appropriateness;  £(1,  129)=  1 16.621,  a  <. 001  for  Interest;  and  £(1, 
129)  =  14.476,  a  <  .001  for  confidence  Subjects  typically  scored  higher  on 
the  posttest  than  on  the  pretest.  This  is  a  common  result,  probably  due  to 
familiarity  with  the  Instrument  as  a  consequence  of  the  pretest  session. 

Multivariate  analysis  for  Job  showed  significant  differences  as  well, 
(A  :  .73972),  £(21, 2588)  =  13.641,  Q  <  .001.  Results  from  univariate 
analyses  were  also  significant;  for  appropriateness,  £  (7, 903) :  26.606, 
a  <  .001;  for  Interest,  £  (7, 903)  s  15.567,  ft  <  .001;  and  for  confidence, 
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£  (7, 903)  s  28.007,  ft  <  .001.  This  Indicates  some  careers  were  perceived  as 
more  appealing  than  others. 

Two-wau  Interflctions 

The  multivariate  analysis  of  variance  performed  on  the  group  by  test 
interaction  revealed  a  significant  difference  showing  that  the  experimental 
group  experienced  greater  positive  change  than  the  control  group, 
(A  s  .93413),  £  (3,  127)  s  2.985,  B  <  .05.  Univariate  analyses  for  the 
dependent  variables  appropriateness  and  Interest  showed  no  significant 
differences  (q  >  .05),  but  the  univariate  analysis  for  confidence  was 
significant,  £  (1, 129)  =  5.557,  q  <  .05.  While  both  groups  showed  gain  from 
pretest  to  posttest,  the  experimental  group  hod  a  significantly  larger  gain 
in  confidence  in  being  successful  in  the  Jobs. 

No  significant  difference  was  found  in  the  multivariate  analysis  of 
the  group  by  Job  interaction.  Both  groups  held  similar  views  of  the  Jobs 
being  tested. 

The  test  by  Job  interaction  revealed  significance  in  both  the 
multivariate  and  univariate  cases.  The  multivariate  analysis  yielded  a  large 
difference,  (a  =  .84521),  £  (21,  2588)  =  7.432,  b  <  .001.  Univariate  analyses 
resulted  in  £  (7, 903)  =  12.234,  u  <  .001  for  appropriateness; 
£ (7,  903)  =  1 1.254,  ii<  .001  for  interest;  and  £  (7,  903)  =  6.837,  fi <  .001  for 
confidence.  This  indicates  that  both  groups  perceived  the  careers  more 
positively  on  the  posttest. 

Three-wflu  Interaction 

The  group  by  test  by  Job  MANOVA  result  showed  a  nonsignificant 
interaction.  Consequently,  univariate  analyses  were  not  explored.  Changes 
within  the  experimental  and  control  groups  were  found  to  be  unrelated  to 
Job. 

Discussion 

In  this  study,  tenth-,  eleventh-,  and  twelfth-grade  female  students 
from  advanced,  elective  science  courses  read  about  and  discussed 
successful  women  in  traditionally  male  careers.  It  was  predicted  that  their 
attitudes  toward  careers  with  regard  to  (1)  appropriateness  for  both  women 
and  men,  (2)  interest,  and  (3)  confidence  in  their  ability  to  be  successful 
would  become  more  positive.  It  was  also  expected  that  those  poeitive 
attitudes  would  generalize  to  careers  that  were  not  presented.  Results 
showed  that  for  the  experimental  group  there  was  a  significant  positive 
change  in  confidence  across  all  eight  careers  surveyed  on  the  posttest,  both 
those  that  had  been  presented  in  the  intervention  and  those  that  had  not. 
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The  generalization  effect  did  take  place.  There  were  no  significant 
differences  for  the  variables  appropriateness  and  interest. 

The  intervention  was  not  effective  In  changing  young  women's 
attitudes  with  regard  to  the  appropriateness  of  the  careers  for  both  women 
and  men.  However,  the  data  suggest  that  there  was  a  ceiling  effect  that  had 
not  been  observed  in  earlier  related  research.  The  highest  score  possible  on 
this  measure,  3.000,  was  evidenced  on  10  of  the  32  items.  This  indicates 
that  the  instrument  was  not  sensitive  enough  to  adequately  measure  the  full 
range  of  student  attitudes.  The  high  scores  throughout  raise  the  question  of 
the  efficacy  of  intervening  with  this  relatively  sophisticated  population. 
The  young  women  in  the  study  may  have  benefitted  from  societal  changes  of 
the  pest  few  years. 

Though  interest  in  the  careers  did  Increase  somewhat,  the  difference 
between  the  groups  was  not  significant.  Treatments  of  one  to  five  class 
periods  in  length  have  not  demonstrated  effectiveness  in  increasing 
students'  interest  in  careers  not  traditional  for  their  sex  (Brooks,  Holahan, 
&  Galligan,  N85;  Savenye,  1985).  Apparently,  more  powerful  and  longer- 
lasting  interventions  are  required.  Perhaps  it  is  necessary  to  help  students 
determine  their  interests  and  skills  and  relate  these  to  career  opportunities 
and  Job  responsibilities. 

Appropriateness,  interest,  and  confidence  are  clearly  related,  but  the 
nature  and  extent  of  the  relationship  are  not  understood.  Perhaps  greater 
increase  in  interest  follows  successful  experience  and  increase  in 
confidence.  Higher  self-efficacy  expectations  may  broaden  or  reopen 
occupational  areas  that  previously  had  been  Judged  inappropriate.  Ginzberg, 
Ginsburg,  Azelrad,  and  Herma  (1951)  reported  that  adolescent  males  had 
great  difficulty  identifying  their  interests  and  aptitudes.  They  hoped  to 
discover  their  interests  and  abilities  through  college  or  work  experience. 

The  significant  positive  change  in  confidence  among  subjects  in  the 
experimental  group  supports  Bandura's  (1977)  theory  that  vicarious 
experience  (here,  reading  about  a  successful  role  model)  increases  self- 
efficacy.  Angrist  and  Almquist  (1975)  and  Auster  and  Auster  (1981)  report 
on  the  importance  of  exposure  to,  and  support  of,  role  models  in  young 
women's  nontraditonal  career  choices.  The  generalization  effect  suggests 
that  the  present  intervention  can  be  useful  wUh  a  variety  of  Jobs. 

There  are  three  important  factors  to  consider  in  future  studies.  One 
is  to  work  with  a  younger,  less  sophisticated  group  that  will  have  no  ceiling 
effect.  Additionally,  a  younger  group  may  be  more  persuasible  (Fleming  & 
Levie,  1978).  Another  factor  is  to  work  with  intact  classes  in  which 
students  have  had  time  to  become  comfortable  with  each  other.  It  may  be 
necessary  to  provide  time  to  develop  rapport  between  the  experimenter  and 
the  group  and  among  members  of  the  group  if  it  is  desired  that  the  subjects 
participate  in  a  discussion.  A  third  factor  is  to  understand  what  qualities 
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iind/or  values  females  attribute  to  particular  jobs  and  what  job 
characteristics  ere  important  to  them.  Careers  can  be  analyzed  and 
presented  in  terms  of  the  attributes  and  responsibilities  that  may  appeal  to 
females. 

Perhaps  it  is  true,  as  Gottfredsun  (1981)  suggests,  that  by 
adolescence,  occupational  choices  have  been  limited  to  what  Is  pi^rceived  ac 
appropriate  for  one's  own  sex.  A  variety  of  activities  —  including  hands-or. 
experience,  observing  and  talking  with  role  models,  site  visits,  assessment 
of  interests  and  abilities,  and  a  relating  of  skills  and  valuesto  job 
responsibilities  —  may  be  required  cn  an  ongoing  basis  to  promote  positive 
and  stable  attitudes  toward  the  full  range  of  occupational  opportunities 
available  today. 
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Table  1 

Descriptive  Statistics  Regarding 
Attitudes  Toward  Nontradltlonal  Careers  by  Treatment  Condition 


Experimental 


Careers 


Pretest 


i!  SIL 


Control 

ElSlasL  Posttest 
U  SD       M  ai. 


Industrial  engineer 
appropriateness 
Interest 
confidence 

food  chemist 
appropriateness 
Interest 
confidence 

petroleum  geologist 
appropriateness 
Interest 
confidence 


2.714 
1.571 
2.222 


3.000 
1.714 
2.254 


2.810 
1.651 
2.222 


.705 
.856 
1.170 


.000 
.941 
1.092 


.592 
.970 
1.128 


3.000 
1.905 
2.762 


3.000 
1.762 
2.683 


2.968 
1.730 
2.524 


.000 
i.043 
1.341 


.000 
.979 
1.242 


.252 
1.019 
1.216 


2.588 
1.765 
2.500 


2.956 
2.132 
2.750 


2.838 
1.868 
2.515 


.815 
.948 
1.153 


.270 
1.064 
1.064 


.536 
1.050 
1.240 


2.868 
2.088 
2.794 


2.926 
2.132 
2.912 


2.750 
1.779 
2.618 


.486 
1.1 16 
1.264 


.315 
1.105 
1.278 


.655 
.928 
1.222 


fish  &  wildlife  biologist 

appropriateness  3.000  .000  3.000  .000  3.000  .000  2.912  .376 

interest  2.365  1.182  2.571  1.353  2.485  1.275  2.794  1.166 

confidence  3.000  1.218  3.328  1.388  3.074  1.176  2.618  1.176 


Note.  Item  responses  for  appropriateness  were  obtained  on  a  3-po1nt  scale  with  "men"  as  (I), 
"women"  as  (2),  and  "both  men  and  women"  as  (3).  Item  responses  for  Interest  end  confidence  were 
obtained  on  a  5-po1nt  scale  ranging  from  "not  at  all"  (1)  to  'very"  (5)  Interested  and  confident. 


Table  1  (continued) 


Careers 


optometrist 
approprlf^teness 
Interest 
confidence 

biomedical  engineer 
appropriateness 
Interest 
confidence 

forester 
appreprlateness 
Interest 
confidence 

veterinarian 
appropriateness 
Interest 
confidence 


Pretest 
J3  SD. 


Experimental 

J[J!J=fi2)_ 


Posttest 
iJ  SIL 


2.984 
2.397 
2.904 


2.921 
2.175 
2.413 


2.873 
1.696 
2.413 


3.000 
2.857 
3.127 


.126 
1.225 
1.254 


.373 
1.302 
1.291 


.492 
.891 
1.253 


.000 
1.318 
1.350 


3.000 
2.651 
3.270 


3.000 
2.206 
2.794 


2.968 
2.143 
2.889 


3.000 
3.063 
3.381 


.000 
1.285 
1.139 


.000 
1.138 
1.246 


.252 
1.148 
1.271 


.000 
1.243 
1.288 


Pretest 
il  SIL 


Control 


2.971 
2.235 
3.1 18 


2.824 
2.235 
2.618 


2.765 
1.647 
2.574 


2.956 
2.588 
3.162 


.243 
1.148 
1.166 


.571 
1.198 
1.339 


.649 
.927 
1.213 


.270 
1.318 
1.288 


Posttest 
i1  SIL 


2.971 
2.721 
3.368 


2.882 
2.662 
3.176 


2.824 
2.088 
2.809 


2.971 
3.044 
3.456 


.170 
1.118 
1.145 


.441 
1.288 
1.257 


.571 
1.156 
1.385 


.170 
1.251 
1.321 


ERIC 


Table  2 

Multf  vaiiote  and  UnWarlote  ANOVA  Source  Table 
for  Appropriateness,  Interest,  and  Confidence 


Source  of 
Variance 


Wflk's 
Lambda 


Multivariate 


M. 


-flL 


Univariate 
F 


main  effects 
group 
appropriateness 
Interest 
confidence 

test 

appropriateness 

Interest 

confidence 

career 
appropriateness 
Interest 
confidence 


.98853      3,  1 27 


.49 1  ns 


.34219      3,127       81.378  .001 


.73972     21,2588     13.641  .001 


1,  129 

.016 

ns 

1,  129 

1.055 

ns 

1,  129 

.611 

ns 

1,  129 

182.737 

.001 

1,  129 

116.621 

.001 

1,  129 

14.476 

.001 

7,  903 

26.606 

.001 

7,  903 

15.567 

.001 

7,  903 

28.007 

.001 

ERIC 


fl 

Table  2  (continued) 

Source  of 
Variance 

Wllk's 
Lambda 

Multivariate 
df  F 

D 

df 

Univariate 
F 

n 

two-way  Interactions 
group  by  test 
appropriateness 
Interest 
confidence 

.93413 

3,  127  2.985 

.05 

1,  129 
1,  129 
1,  129 

.966 
.067 
5.557 

ns 
ns 
.05 

group  by  career 
appropriateness 
Interest 
confidence 

.97096 

21,2588  1.271 

ns 

7,  903 
7,  903 
7,  903 

1.490 
.608 
1.196 

ns 
ns 
ns 

test  by  career 
appropriateness 
Interest 
confidence 

.64521 

21,2588  7.432 

.001 

7,  903 
7,  903 
7,  903 

)  2.241 
1 1.254 
6.837 

.001 
.001 
.001 

three-way  interaction 
group  by  test  by  career 
opproprloteness 
Interest 
confidence 

.96186 

21,2588  .767 

ns 

7,  903 
7,  903 
7,  903 

1.627 
.934 
.508 

ns 
ns 
ns 

ERIC 
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Teachers  and  itet^^ngy. 
An  Acorcorlate  Mtadel  to  Linle  Pei^earch  vith  PraH-tr^ 


niis  paper  grows  out  of  an  Incaceasing  frustration  with  the  direction 
taten  by  research,  develcapnent,  and  practice  in  the  field  of  educational 
technology  over  the  past  dozen  years.  Ohat  frustration  has  roots  that  are 
ocBplex,  but  the  tension  itself  nay  be  siaply  expressed:  although 
educational  technology  was  in  its  origins  intimately  connected  with  the  work 
of  tead]srs  and  schools,  in  recent  years  the  focus  of  the  field  has 
incraaslngly  shifted  toward  applications  in  business,  industry,  and  higher 
education,   ihose  research  studies,  developnent  and  iitplementation  projects, 
and  evaluation  reports  that  do  concern  themselves  with  K-12  settings  nay 
take  a  diffUsim-and-adoption  approach  to  teachers'  use  of  hardware, 
consider  a  particular  nedium's  effectiveness  as  an  instructional  tool  to 
readi  particular  objectives,  or  exanine  the  applicabUity  of  some  specific 
Instructional  developnent  (ID)  nodel  to  the  organization  and  delivery  of 
curricular  Material  in  one  or  more  subject  dcmains. 

Those  educational  technologists  who  have  surveyed  the  scene  in  the 
public  schools  (e.g.,  Hfelnich,  1984,  1985)  often  assert  that  the  only 
sensible  approach  is  to  encourage  rapid  and  oonprehensive  acceptance  of  a 
strict  ID  app.-oach  to  the  design,  Inplementation,  and  evaluation  of 
instruction  in  the  scaiools.  Hteinich  particularly  decries  the  continued 
"craft"  ^proadi  to  their  work  among  teachers,  and  sets  this  in  cpposition 
to  a  "technological"  approach.  The  field  of  educational  technology,  he 
suggests,  has  nore  to  do  with  technology  than  it  does  with  education. 
Others  (e.g. ,  Branson,  1987)  are  less  specific  in  their  criticism,  but 
Intimate  that  the  rationale  for  the  existence  of  schools  (almost  always 
discussed  in  texas  of  knowledge  production  and  transfer  of  information  to 
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ia»  raoeb  generation)  has  been  so  seriously  lapacted  by  technology  and  other 
ehangee  that  their  presenoe  as  a  social  institution  past  the  year  2000  must 
be  qpMstlonad. 

ais  is  i*at  I  f Ind  troubling,  for  sdiools  as  a  social  institution 
oflUectlvely  have  other  (and,  many  would  argue,  noce  important)  purposes 
than  the  transmission  of  infonnation  to  their  charges.  Teaciiers,  too,  are 
van  than  classnxnrisased  iaplenentors  of  instructional  strategies,  m 
tact,  there  has  been  during  the  past  years  such  discussion  about  the  radical 
rafom  of  schooling,  and  about  teachers'  key  role  in  that  process, 
discussion  v*ldi  educational  technologists  (with  a  very  few  notable 
««ptlons)  do  not  seem  to  have  acJowwledged,  much  less  joined,    if  schools 
and  teachers  will  continue  to  exist  in  sane  form,  then,  and  if  the  largely 
antithetical  positions  described  here  ar«  in  fact  representative  of 
teachers'  and  technologists'  views,  how  should  educational  technologists 
oonoemed  with  public  education  proceed? 

Ihis  paper  first  reviews  educational  technology  and  teachiig, 
considering  each  field  fran  two  perspectlves-that  of  the  technologist,  and 
that  of  the  teacher.    It  then  characterizes  the  current  state  of  the 
movement  to  radically  restructure  education,  and  suggests  how  educational 
technologists  might  join  in  and  contribute  to  that  dlsaisslOT^^   It  concludes 
with  suggestions,  drawn  trm  current  research  on  teaching  and  on  educational 
practice,  for  nerv  initiatives  that  educational  technologists  might  take  in 
four  areas:    (i)  the  preparation  of  models  for  teachlng-with-technology;  (2) 
the  design  of  intelligent  software;  (3)  the  creation  of  technologically- 
based  tools  to  support  teachers'  professional  work  and  developnent;  and  (4) 
the  hpeavment  of  research  about  technology  in  education. 
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Itoachers  and  Technolog/  3 
Saucatlonal  Teehn^l^^Ty 

tftrtmnloalst'a  v<?i»^    I  do  not  need  to  recite  here  the  recent 
history  of  the  field  of  eduoaticnad  technology,   others  have  adequately 
chronicled  the  gradual  transition  frcn  a  focus  cn  devices  to  a  concern  with 
process,  the  shift  to  an  enfiiasis  on  the  definition  of  systematic 
instructional  models  and  praoedures,  and  the  gradual  growth  of  interest  In 
cognitive  as  well  as  behavioral  principles  as  conceptual  underpfiiing  for 
the  field  (Reiser,  1987;  Saettler,  1968) . 

Ihe  result  of  this  activity  has  been  the  creation  of  instructional 
design  and  dsvelopnent,  a  oonblnaticn  of  elegant  Instructional  models 
(design)  and  practical  procedures  (developBent)  for  the  delivery  of 
Instruction.   Nb  one  can  really  deny  at  this  point  the  pcpularity  and 
practical  appeal  of  id  as  an  approach-note  the  rapid  growth  of  DID  withlh 
AECT,  the  oonccBdtant  growth  of  other  similar  associations  and  groups  (NSET, 
ASID/  etc.),  and  the  suooess  of  ID  as  an  approach  In  business  and  Industry 
(evidenced  by  the  expenditure  by  businesses  of  an  amount  annually  roughly 
equivalent  to  all  the  costs  of  higher  education  in  this  country). 

nie  point  is  that  activities  of  educational  technologists,  defined  now 
largely  In  terms  of  instructional  design  and  developnent,  are  Increasingly 
distanced  fran  the  work  of  ordinary  teachers  In  the  public  schools.  Rich^ 
(1986),  for  exasple,  opens  her  book  with  the  following: 

Planning  instructional  programs  and  materials  has  been  separated 
trm  the  jobs  of  those  v4io  actually  deliver  the  instruction  In  a 
growing  number  of  situations....  Bie  dichotcny  between  instruction 
and  Instructional  design  ...  is  ...  influenced  by  different 
theoretical  orientations  and  different  practice  histories  (p.  2) . 
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Htm  tact  of  this  division  is,  hcMsvar,  sonething  about  vihich  I  feel  that  we 
as  a  field  oust  be  CGnoemed. 

Schools,  then,  have  been  notably  and  curiously  removed  trm  the 
oonoems  of  technologists.   Those  vdio  have  looked  at  schools  seen  to  feel 
that,  if  cnly  teachers  would  use  ID  e^proaciies,  clasdrocm  practioe  would  be 
vastly  i2qpirm/ed.   StuSents  would  beocns  nDtl^-ated,  instruction  would  beocroe 
clear  and  logical,  student  achieveinent  would  increase,  teachers  would  be 
freed  ftcm  the  drudgery  of  routine  tasks,  and  dassrocm  activities  would 
beccm  note  varied  (e.g.,  Reigeluth,  1987) .   The  e^pearanoe  recently  of  a 
apecial  thonatic  issue  of  3S2  on  "ID  and  the  Rablic  Schools"  (Salisbury, 
1987)  testifies  to  the  scarcity  of  this  approSiA  in  general. 

Ihe  vision  has  been  renarlcahly  consistent.   Ihe  problem  has  been  that 
teachers  have  been  slew  to  respond,  either  to  the  blandishments  of  those  v*io 
have  enccuraged  teadiers  to  use  technology-as-hardware,  or  to  the 
suggestions  of  those  viho  have  maintained  that  ID  mic^t  provide  solxitions  to 
educational  problesns.  As  Goodlad  (1984)  and  Cuban  (1984)  have  pointed  out, 
most  classrocn  practice  today  lodes  remaricably  like  classroom  practioe  80  or 
100  years  ago.   The  expectations  and  hopes  of  technologists  have  changed; 
reality,  in  the  main,  has  not. 

fm^^*^  vision.    Yet  classrocn  teachers  do  turn  to  educational 
technology,  if  often  for  reasons  other  than  those  technologists  mi^t  hope. 
For  most  teachers,  "educational  tedinology*'  still  iinplies  hardware  and 
associated  software,  not  the  process  approach  of  ID.   Shewing  films  and 
tapes,  for  exanple,  offers  relief  frm  the  routine  of  classrocm  interaction, 
and  many  teachers  choose  consciously  to  do  this.   Cuban  (1986)  quotes  a 
teacher,  **Scnietimes  the  motor  needs  to  idle  before  it  is  put  bade  into  gear** 
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(p.  69) .   Pilms  and  tapes  nay  also  provide  a  "trigger,"  a  stinulus  In 
conjunction  with  work  toward  "expressive  outcomes"  of  leamii^  that  are 
purposely  not  defined  ty  the  teacher  In  advance  (Eisner,  1979) .  Etograns 
and  software  used  In  such  an  e)?doratory  fashion  nay  also  open  an  avenue  for 
experiencing  the  world  In  ways  otherwise  lirpoeslble  (Ocpeland,  1984,  1986). 

Woridng  with  the  tools  of  technology  nay  also  provide  for  students 
cpportunitles  for  personal  enpowement  and  personal  liberation  not  otherwise 
easily  found  in  classroans.   Ellsworth  rjsi),  fbr  exanple,  described  the 
ways  in  whidi  the  production  of  videotapes  could  enhance  students'  awareness 
of  social  problens  and  their  sense  of  enpowement  to  act  in  regard  to  those 
prcblens.   And  Schwartz  (1987)  used  video  with  underprivileged  yo«^^ 
engage  them  in  academic  activities  that  otherwise  would  have  been  unlikely 
to  succeed.   Mos- teachers  probably  see  such  approaches  as  nore  essential  to 
their  roles  as  teachers  and  to  the  learning  of  their  students  than  a 

strictly  defined  application  Of  instructional  design  and  develo5««^  When 
teachers  do  confront  the  technologist's  vision  of  precisely  engineered 
materials,  controlled  experiences,  and  measured  outcanes,  they  nay  react,  not 
with  enthusiasm  bat  with  rejection  (NUnan,  1983) . 

Only  a  few  researchers  have  consciously  atteitpted  to  define  teachers 
uses  of  and  ideas  about  technology.   Cuban's  (1986)  book  is  one  notable 
exception;  another  is  the  work  of  David  CChen  (1987)  at  Michigan.  Both 
argue  that  the  teacher's  world  is  substantially  United  by  powerful  social 
and  administrative  pressures  to  teach  in  particular  ways.   Even  if  teaciiers 
did  want  to  think  about  educational  technology  as  scnething  larger  than 
machines  and  software,  they  have  remarkably  litUe  opportunity  to  do  so. 

Oteachers  are  not  provided  with  or  taught  how  to  use  more  helpful  alternaU^ 
models  during  teacher  training. 
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Ttm  tfKlTTTffil Wirt's  vlfflq).   Ihe  metaphoxs  used  In  descriptions  of 
•duoational  technology  teU  us  much  about  tedhnologists'  views  of  the 
iMtructora  with  v*cn  they  work.  HlynJa  and  Itelscn  (1985)  identified  three 
danlnant  nataphorB  for  educaaonal  technology  in  the  literature  of  the 
field:  "tools,"  "engineering,"  and  "systemic"  (in  a  broad  artistic  and 
aesthetic  sense  «hicfe  they  likened  to  i«Bical  perfornan*  Uhfortunately, 
aany  technologists  unconsciously  adept  either  the  "tools"  or  "engineering" 
««taphQr8.   For  these,  teadili^  night  be  defined  as  the  administraaon  of 
instnictional  naterials  or  programs  in  such  a  way  as  to  effect  leami,^. 
While  lip  service  has  been  paid  to  the  possibility  of  addressing  all  types 
of  purposes  of  schooling-the  affective  as  well  as  the  cognitive,  the  lor^- 
tem  as  weU  as  the  short,  the  "higher-order"  and 

criticaVsyntheticyjudgmental  as  weU  as  the  factual  and  objective-in  fact 
most  studies  in  the  field  focus  on  the  latter  part  of  each  of  these 
relations. 

m  fact,  the  way  that  many  educational  technologists  think  and  write 
-bout  teacidng  suggests  that  the  teacher's  role  is  sanething  to  be  refined 
-nd  Shaped  by  principles  Of  instructional  design:   inconsistencies  are  to  be 
anoothed  out,  digressions  eliminated,  predictability  developed.  Ihe 
principal  product  of  the  educational  technologist's  work~a  carefully 
Pr^ared  set  of  instructional  procedures-is  designed  In  such  a  way  as  to 
Blnliidze  the  teacher's  cortxlbution.   Indeed,  many  educational  tecihnologists 
would  posit  that  an  laportant  aspect  of  their  work  is  to  eliminate  the  need 
to  have  a  human  Instructor  present. 

BJucational  technologists  have  also  been  seen  as  "ciiange  agents," 
•noouragers  Of  new  instructional  practices  and  procedures,   visions  of 
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ei^tlGnal  change  are  thus  also  laportant  for  us  to  esnnine  In  seeking  to 
understand  technologists'  views  of  teaching.   Earlier  experience  has 
cwitioned  those  educational  technologists  nost  eager  to  redefine  the 
teacher's  role  in  terns  of  dependency  cn  engineered  design.   Attaints  in  the 
1950«  and  1960s  to  penetrate  the  education  nartet  with  teaching  machines 
with  names  such  as  "techno-teacher"  and  "auto-tutor"  proved  notably 
unsuccessful,  and  the  intensely  designed  (and  thus  "teacher-proof") 
curricula  of  the  1960s  (SSSC  Hxysics,  MA0C3S,  etc.)  either  failed  to  win 
acceptance,  or  were  ncndnally  accepted  but  modified  in  practice  to  such  an 
extent  that  they  became  indistinguishable  froa  the  preceding  classrocn 
routine. 

niese  problems  led  aduoational  technologists  to  conclude  that  "teacher 
adoption"  of  rew  instructional  strategies  was  a  topic  worthy  of  study. 
Early  ideas  about  how  to  change  schools  were  dcninated  by  "rational- 
enpirical"  assunptlons  (Chin  &  Benne,  1969) :    showiig  people  iaprcved 
practices  should  lead  them     change  what  they  do.   Typologies  were 
constructed  of  "inno   tors,"  "early  adopters,"  and  so  on  (Rogers,  1962) . 

Most  educational  technologists  have  accepted  the  assunptions  of  the 
rational-enpirical  model.   Ihey  also  made  other  assuttptiens—that  teachers 
find  technology  (gua  hardware  and  software)  easy  to  use,  that  technology 
(Sm  process)  readily  fits  into  the  context  of  classrocn  activities,  and 
that  instruction  should  become  a  rational  sc  jice.   studies  based  on  this 
model  of  change  examined  teachers  not  only  as  users  of  eduratlonal 
technology  hut  also  as  potential  barriers  to  itr  use.   Teachers'  attitudes 
tcward  cobjxiters,  their  willingness  to  change,  the  extent  of  their 
acceptance  of  technology  have  all  been  considered.    "Resirtanoe  to  change" 
has  been  a  central  topic  for  discussion,  and  infusion  of  technology-as- 
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har*«r«  and  tedmology-as-prooess  have  been  ta3cen  as  a  given  for  the 
lii|JLuvHnsnt  of  taachincf. 

ItW  tWK^'g  vislgn.   Defining  «bat  teaciiers  think  their  work  oonslsts 
of  turns  oifc  not  to  be  an  easy  task.  Several  studies  of  classrocn  life  have 
portrayed  tsachses  as  earnest,  but  harried.   The  job  of  managing  25  or  30 
young  people  in  a  confined  space  for  nary  hours  each  day  «5)lains  wi.y 
"classrocn  nanagementH  is  such  a  perennial  favorite  in-service  worJcshop 
topic  aiDong  teachers,   ttat  teaching  is  work  (and  thus  not  always  the 
glaaarcws  "life  of  the  mind"  or  pleasant  "being  with  children"  that  seme 
P»-aervioe  teachers  hcpe),  that  it  is  hard  (elementary  schools  experience  a 
turnover  of  more  than  7%  of  their  teachers  each  year;  secondary  schools, 
nore  than  6%;  Center,  1987),  and  that  it  provides  few  rewards  other  than  the 
psychic  are  facts  about  their  careers  that  most  teachers  recognize  only 
after  they  have  been  teaching  for  a  year  or  two. 

Itewthaless,  teachers  do  usuallj  create  for  themselves  a  classrocn 
world  that  r         -  both  their  teachlig  style  and  their  pteferted  ways  of 
waking  wi.         ants.   Characteristics  of  that  world  have  been  limned  in 
several  studies  over  the  past  several  years  (Lortie,  1975;  Dreeben,  1973; 
Jacikson,  1986):   teachers  often  feel  Isolated  fixn  their  peers,  but  find 
sustenance  in  the  routine  of  classrocn  life;  they  resent  Ijttrusion  from 
outside,  and  find  most  administrative  requirements  to  be  "red  tape"  that 
thay  would  rather  do  without;  their  interest  in  constnicting  curriculum 
thani  .?lves  or  developing  alternative  Instructional  materials  (other  than  a 
traditional  textbook)  is  severely  constrained  by  a  lack  of  time  for  anythii^ 
other  than  the  most  basic  classrocn  maintenance,  leading  in  turn  to  an 
almost  ovenAelming  danand  for  "the  pracUcal"  (Doyle  &  Rander,  1977/78)  in 
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In  addition  to  these  general  features  of  classrocm  life,  recent  studies 
on  the  professional  knowledge  base  of  teaching,  teachers'  thought  processes, 
and  the  school  setting  have  illustrated  the  demands  on  attention  and  effort 
that  a  teadjer  tj/pically  must  ocpe  with  In  daily  work  (e.g. ,  I^iman-ifenser  & 
Floden,  1986).   Besearch  on  teacher  thinking  has  pointed  out  the  dilennnas 
and  uncertainty  that  teachers  routinely  face  (aark,  1988;  Feterscn,  1988). 
Inquiry  into  the  nature  of  teachers'  professional  knowledge  has  suggested 
that  the  links  between  teaching  practices  and  particular  curriculum  content 
nay  be  more  subject-specific  than  previously  thought  (e.g.,  Shulman,  1987). 
And  teachers  have  been  urged  to  beocne  mora  professional  not  by  adopting  a 
routlnistic  approacii  to  problem  solviirr,  but  by  beocndng  more  "reflective" 
(Schon,  1987)  and  by  oelebratli^,  not  rejecting,  the  image  of  their  work  as 
a  craft  (Greene,  1984) .   m  aU  these  cases,  emerging  evidence  highlights 
aspects  of  the  teacher's  work  that  are  ambiguous,  uncertain,  difficult  to 
cast  into  the  molds  educational  technologists  have  wrought. 

Educational  Reform  and  the  Educational  TVyhnoloa^st-- 

Ihe  past  six  years  have  witnessed  a  growing  interest  In  general 
educational  reform.    Perceived  declines  In  academic  standards  led  to  a 
nuniber  of  critical  reports  In  the  early  1980s  (e.g.,  Ifcitional,  1983;  Bqyer, 
1983;  Education  CSamnission,  1983) .   student  abilities  In  mathematics  and 
science  became  objects  of  special  concern  (National  Science  Board,  1983; 
College  Board,  1983) .   Among  the  other  problenis  dealt  with  in  this  phase  of 
the  reform  movement  were:   the  role  schools  play  In  the  national  econcny; 
the  effectiveness  of  schools  In  providing  students  with  a  core  set  of 
cultural  assunptions  and  values;  and  the  need  to  acoonnnodate  through 
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adioollng  dlvarw  ethr'x:  and  linguistic  groags  In  the  larger  national 
ailture.  B»  feasibility  of  introJuclng  to  sciiools  new  technology 
(•apaclally  aapitew)  for  Instruction  and  management  also  becane  a  oonoem 
at  this  stags  of  the  refom  effort. 

Biis  "first  wave"  of  school  reform  has  no^r  been  overtaken  by  a  further, 
and  possibly  note  significant,  "second  wave"  Of  reform.   Hie  n«,  emphasis  is 
cn  the  need  for  significant  restructuring  of  the  organization  a«a  practices 
Of  schools  as  preconditions  for  any  further  significant  change  in  education 
(AFT,  1987-88;  Eisner,  1988;  Elmore  4  Mclaughlin,  1988).   nie  role  of  the 

teacher  in  defining  vtet  h^  lu  sdiools,  ha,  studert:s  are  to  be  taught 
(and  ha,  taac*ars  th^ves  ar .  to  be  selected,  educated,  and  certified) , 

are  the  critical  ques^-lons  for  stcond-^  reformers.  Jose0i  McDonald 
(1988)  described  this  sa:axi  wave  as  the  sear*  for  "the  teacher's  voice." 
Ihe  central  issues  involved  might  be  ciiaracterizec?  as  f 

Pmwratlalm  gdnilnlPtmigD.   a  toy  feature  of  the  new 

P«^»sals  is  building-based  management  of  ^is,  under  which  teachers 
themselves  play  a  significant  role  in -ianagement.   Ihe  oonc^  of 
"teacher  leadership"  appears  frequently  in  these  discussions  (Barth, 
1988;  Sirotnlk  &  Qark,  1988). 

Tmk;^  S9lf-npn?^qp,yni.  r^nn  nrefessSnn.i  ^«>^i^nt    Tteachers  are  to 
have  an  Inportant  role  in  making  professional  decisions.  These 
Include:   selection  of  curricula,  instructional  materials,  teachir^ 
approaches;  decisions  on  research  to  be  carried  out;  evaluation  of 
peers  both  for  entry  into  the  profession  and  for  merit  and  advancement ; 
and  design  and  luplementation  of  further  professional  education 
(Liebenuan,  1986;  Shulman,  1987). 
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AltgPgd  glflSSTpogm  roles  and  e^lH^Mfi^,s  on  critieal  thinkina  aVi\^n. 
Teachers  are  demanding  professionally  significant  changes  In 
traditional  classroan  arrangements.   These  include  many  shifts  that 
technology  can  make  possible-a  ciiange  txxn  being  the  source  of 
Icnowledge  to  being  a  guide  or  coac4i  to  students;  a  change  tram  ftontal 
instruction  to  diversified  classroan  activities;  and  an  expanded 

variety  of  instructional  models  and  practices  recognized  as  legitimate. 

one  key  aim  of  these  practices  is  to  increase  students'  abilities  to 

reflect  thoughtfully  on  what  they  have  learned,  not  merely  regurgitate 

facts  (e.g.,  Sternberg,  1985;  Tucker,  1985). 

wodgg  of  research  on  twrhi«T  ;.nH  i^^r*^^  T»^r^i']r^  These 
changes  involve  the  role  of  colleges  of  education  and  their  faculty. 
Colleges  are  to  vioric  more  closely  with  teachers  in  defining  teacher 
preparation  courses;  there  is  to  be  less  en^hasis  on  courses  in 
pedagogical  methods  that  do  not  meet  teacihers-  practical  needs  (HbUnes 
Group,  1986;  Task  Force,  1986) .   Faculty  are  to  work  directly  with 
teachers  in  "professional  developnent  centers".   Research  should 
include  anthropological  study  of  classroons  and  examinations  of 
teachers'  professional  thought-ln-action. 

Educational  TechnolngY       V''.'^^>tianal  Refan? 

Teadiers  Increasingly  are  demanding  a  larger  say  in  how  schools  ar« 
organized  and  run.  Assuming  that  teachers  will  not  accept  educational 
technology  unequivocally  and  enthusiastically  as  either  "new  tools"  or 
"systematic  engineering,"  what  role  might  ther«  be  for  technologists  either 
in  supporting  the  reform  of  schooling  or  in  providing  useful  data  to  policy 
naters?  Several  directions  suggest  themselves  immediately:    (l)  preparation 
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of  models  of  teachlng-with-technology,  (2)  design  of  software,  (3)  cxeation 
of  OGB{Utai>based  .tools  to  stpport  teadhers'  professional  develocnent,  and 
(4)  iBiaLXivuuuiit  of  xeseazch.  These  are  <iiiiia.T8sed  below  as  an  agenSa  for 
iniaxvlngr  the  vise  of  technology  in  education. 

Pgyglonoent  of  models  of  teachlj«-wi^tl-^«w;ty|r>ir^    Teadhers*  everyday 
classroom  work  Involves  great  tancertainties  regarding  Instructicnal  methods 
and  outrxxnes  (Floden  &  Clark,  1988) .   Haaa,  teachers'  models  of  teachai^— 
mental  images  of  hew  a  dassrocm  she  old  look  and  feel,  i<^c:^9  about 
activities,  ways  of  integrating  instnictional  materials  with  lessons—are 
often  less  organized  and  less  goal-oriented  than  technologists  would  prefer. 
Rather  than  try  to  supplant  the  models  and  practices  that  teachers  have 
developed  to  cope  with  the  uncertainties  of  their  world,  we  should  be  trying 
to  develop  models  cf  teaching-with-technology  (in  the  sense  of  us^.ng  t.Tols, 
materials,  and  approaches)  that  recognize  those  problems,  seek  to  alle/iate 
their  iapact,  and  provide  at  the  same  time  the  ciportunity  for  teachers  to 
expand  their  thinking  about  vhat  is  possible  in  the  dassraan. 

Ihe  first  part  of  this  task  is  therefore  to  understand  better  teachers' 
models  of  daily  classrocm  activity,  what  place  technology  has  in  those 
models,  and  vhat  meaning  technology  has  in  the  context  of  the  constraints 
and  uncertainties  with  which  teachers        deed.   Part  of  this  Investigation 
of  meanings  aust  deal  with  the  unconscious  assunptions  that  teachers, 
students,  and  parents  make  about  the  role  and  value  of  technology  in 
education,  how  successes  or  failures  are  ascribed  to  persons,  materials,  or 
approaches.   Another  part  must  probe  teachers'  motivations  and  sources  of 
reward  in  teaching,  and  consider  those  in  relation  to  what  technology  either 
provides  or  takes  away. 


Bproved  information  about  the  realities  of  the  teacher's  world,  about 
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the  perceived  role  and  value  of  teaching,  of  various  teaching  activities, 
and  of  the  use  of  technology  In  teaching,  can  then  feed  the  (Savelopnent  of 
models  of  teaching-with-technology.   Several  desirable  features  of  such 
models  are  clear:   most  iaportantly,  they  should  accept  the  constraints 
under  v*iich  teachers  must  work  while  they  also  expand  the  teacher's  idea  of 
>aiat  is  feasible;  they  should  reduce  a  teacher's  burtSen  of  unrewarding 
classrocn  work  (e.g.,  repetitive  tutoring,  grading  exercises) ,  buttress  a 
teacher's  position  as  guide  and  iuEator  for  students,  and  demand  minimal 
extra  time  for  preparation;  they  should  also  be  supported  by  appropriate 
prior  training. 

Uhfortunately,  creating  and  disseminating  such  mcxSels  has  been 
difficult.   Wine  there  have  been  iaportant  d*nnonstration  projects  that  s^ 
%tet  technology  can  do  in  selected  classrocns  (e.g. ,  GiE's  "Smart 
Classrocn"/  WICAT's  waterford  School),  these  have  usually  focused  on  vhat 
can  be  done  under  optimal  conditions,  rather  than  on  attenpts  to  integrate 
technology-as-tools  and  technology-as-process  into  environments  of  typical 
schools  and  teachers.   Biey  have  also  routinely  stressed  the  massive 
infusion  of  hardware  plus  a  caiplex  of  software  developed  according  to  a 
single  model  of  instruction.   Teaching-with-technology  requires  more  than  a 
Stakhanovite  a^proadi  to  demonstratirer  what  is  possible.   More  inportant 
than  demonstration  centers  or  schools,  in-service  workshops,  or  summer 
Institutes,  are  models  that  provide  a  well-articulated  vision  of  how  a 
particular  approach  can  work  in  a  real  classrocm  (cf .  other  work  on  teaching 
models  and  how  best  to  ocoBnunicate  them  to  teachers-->Jqyoe  &  Weil,  1986; 
Weil  and  Joyce,  1978a,  1978b,  I97ac) . 

One  useful  approach  to  the  developnent  of  such  models  may  be  through 
the  work  currenUy  being  done  at  Stanford  by  Lee  Shulman  and  his  associates 
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In  a  project  entiUed  "Khowledge  Growth  In  a  Profession."  Ihls  work 
lUumlnates  relationships  ancncr  curriculum  content,  instructional  strategies 
and  approaches,  and  the  underlying  structure  of  disciplines.  While  those 
^  train  teacAHrs  and  instructors  often  assuide  that  there  are  many  generic 
teadilng  strategies,  the  findings  trm  this  project  suggest  otherwise. 
Although  there  are  indeed  a  few  strategies  that  are  general  (included  in 
^  Shulioan  and  his  ooUeagues  call  "General  Ifedagogical  Khowledge"),  there 
Is  a  larger  set  of  infomation  about  instructional  strategies  that  is  linked 
dl«ctly  to  the  structure  of  disciplines  and  the  syortetctic  relationships 
Moig  oono^  and  approaches  in  discipline-specific  fields (Shulman,  1987) . 

called  "Pedagogical  Content  Khowleoge,"  this  infonnation  includes 
taowledge  of  students'  understandings  and  misunderstandii^,  curricular 
ta^'ledge,  ca«ptions  Of  how  to  teach  the  subjert^ 

instructional  repertoire.   It  may  be  that  teachers'  definitions  of  the  place 
Of  technology  in  teaching  (see,  e.g.,  Grossman  fi  Gudmundsdottir,  1987,  on 
t«tbcx*8])  are  intuitively  more  discipline  specific  than  we  have  thought. 
If  so,  this  needs  to  be  discovered. 

Pg^QPPCTt  of  s,ippprtivB  ^ftv^r^.    Ihe  large  initial  enthusiasm  for 
the  use  Of  oapxters  in  education  is  ncv  being  tenpered  by  a  rea^^^ 
thitt  software  needs  to  provide  ncare  than  Intrigui:^  gamas  or  electronic 

«oricbo6ks.   n«re  are  two  particular  prtijlems  with  Instructional  mterlals 
that  are  also  related  to  the  reform  agenda,  problems  that  educational 
technologists  cculd  profitably  address. 

First,  there  is  the  problem  of  Ucw  instructional  materials  are  designed 
and  tested,         changes  inherent  in  school  reform  will  require  that 
technologists  devote  more  time  to  initial  needs  assessment  with  teachers  and 
that  they  put  greater  emphasis  on  user  concerns  throughout  the  process  of 
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design.   Ihis  need  is  new  being  effectively  acknowledged  by  human-factors 
psycJiologists  and  cognitive  scientists  vrarking  on  interface  design  for 
general-furpose  and  business  software  (e.g. ,  Norman  &  Draper,  1986;  Carroll 
&  Rosson,  1987) .   A  further  requirement  for  software  products  will  be  a 
greater  degree  of  teacher  ccattrol  and  i.adif lability  (see  Hativa,  1986,  for 
an  e9eBoai|)le) .   Critical  hers  is  for  educatlcnal  technologists  to  nave  as  far 
as  possible  auay  frcn  the  earlier  ocnoept  of  "teacher^jroofing"  mterdzds. 

A  further  txseful  approach  is  to  provide  teachers  with  programs  that  are 
instructive  to  both  student  and  teacher  (without  being  too  obvious  about 
addressing  teachers) ,  that  st^port  activities  seen  by  the  teacher  to  be 
clearly  iaportant.   Pea  and  Korland  (1987) ,  for  exanple,  offer  a  useful 
revior  of  ocnijuter  prcigiaum  that  may  encourage  developnent  of  writing 
ability.   Ihey  maintain  that  the  ccnibinatlan  of  directed  planning,  guided 
writing,  and  evaluation  that  the  variety  of  writing  programs  now  offer  are 
dose  to  a  unified  "cognitive  technology."  Authors  of  certain  of  the  most 
successful  pieces  of  recent  ccraputer  instructional  software  (the  Geometric 
SSSESes,  The  Vovaae  of  the  wimi)  have  maintained  that  these  products  have 
been  ocnsciously  crafted  to  encourage  learning  on  the  part  of  teachers  as 
wall  as  students.   Es^ansion  of  such  efforts  is  at  the  heart  of  v4iat  needs 
to  be  done  in  order  to  mate  teaching-with-technology  a  reality. 

Given  the  reform  agenda,  there  eure  certedn  other  approaches  in 
designing  and  creating  software  that  could  visefUlly  be  e>9lolted  by 
educational  technologists.   One  direction  is  the  preparation  of  programs  to 
allow  more  direct  and  regular  interaction  among  students,  and  between 
teachers  and  students.   New  develop^nts  offer  the  possibility  of  enabling 
collaboration  In  ways  not  before  feasible.   While  interesting  woric  has  been 
done  to  fester  this  )dnd  of  activity  in  joint  writing  or  editing  (Brown  & 
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ISM),  »o»a«Wb.*«  in  other  discipUi«s,  especially  to  lirtc 

t«*«i09y  «lth  th.  oaient  Intense  «ork  to  develcp 
■^les  aung  atudenta. 

iWjgram  tliat  enhance  Botivatlm  am  exeiteaart  and  the  interest 
»t>>d««it.  have  in  learning  a»  a  tether  ,oal  for  tedm^  Educational 
t«*nology  reoenUy  IBS  peid  too  littu  attention  to  those  practit^ 
•*»  ord<tfnal  Jiipetus  for  e«*rli^,      field  «as  to  enhance  students' 
«*lvati«  and  Irterast.  <*at  is  needed  here  is  not  unthinking  use  of  ga» 
I«gra»  or  entertai»»t  ,oft«re,       rather  the  creative  iaxrporaticn  of 
those  el««ts  of  game  design  that  e,^  students,  c^itles  for  fantasy, 
*au«,ge,  and  creativity  («a™,  1531, .   simuaticns  that  are  cp«^ 

ard  .11«      studert:  to  constritt  frcB  a  given  situatl«  (rather 

ttan  hdiding  in  the  intended  «nl^,  am  assigning  to  the  stuj»t  the  ta* 
Of  di.c««di^  it,  are  another  goal  for  designers.   Doctor  ^ 

thi.  atproe*  "the  h»dng  Of  ««Jerful  ideas."   Finally,  there  *culd  he 

att«pt  to  create  program  that  strive  fbr  a  .Wgher  literacy"  in  the 
*»»  ttat  n«  ted^ologies  »te  jossihle  (e.g. ,  lee,  1985/86, .  aose 

««»™d  With  ID  need  t»  recognize  that  there  is  v^ue  to  cF«ness  as  «11 
as  fipecifldty. 


It  is  .  truism  that  teachi,^         occupation  needs  to  bec«e  more  Of  a 
I>»*«-icn.   in  practice,  this  me«B  iiproved  education  tor  tead«rs  befare 
0»y  start  their  careers,  and,  once  they  have  ertarted  on  it,  enhanced 
eapabmty  to  »™g.  their  om         to  caM^te  with  peers  about  c«™ 
P«*le«s,  am  to  lipwe  practice  timjugh  lesearA  and  evaluat^^ 
»*»l<W*«ed  tools  tJ««:  encourage  teac^ 

•l»o  B*a  eteational  tecftnology  more  useful  to  teachers  in  general. 
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Teacher  training  clearly  needs  to  incorporate  more  information  about  and 
experience  with  educational  technology,  both  hardware/software  and  process. 
But  presenting  these  oono^  In  an  isolated  class  (as  is  still  required  in 
many  states)  seem  hardly  the  way  to  go.   More  useful  in  teacher  education 
would  be  aodeling  of  appropriate  use  of  technology  in  general  pre-service 
courses  (both  those  in  education  and  In  the  liberal  arts),  ocrtbined  with 
placement  as  a  student-teacher  in  a  settii^  v*ere  the  student  teacSher  would 

encourter  experienced  teachers  exenplary  in  their  use  of  technology.  VhUe 
there  have  been  calls  for  action  (AACIE,  1937;  Education,  1986;  om,  1988), 
aaaxpriate  modeling  of  technology  during  teacher  education  is  still  much 
the  exception  rather  than  the  norm.   Ihe  new '^f essicnal  develc^ 
centers"  called  for  In  sane  reform  proposals  (to  link  schools,  pre-service 
teacher  education,  and  in-service  training  fto  teachers)  may  be  the  places 
to  provide  esq^rlences  of  this  kind. 

For  practicing  teachers,  technology  has  already  provided  sane  useful 
lower-level  software  tools  to  enhance  the  professionalization  of  their 
position-spreadsheets  for  grading  and  assessment;  word  prx«essors  for 
routine  administrative  reports,  letters  to  parents,  and  pr^tion  of 
instructional  materials ;  databases  for  keeping  track  of  resources  or  student 
work,   tte  problem  here  is  more  one  of  routine  access  than  utility.  A 
cc«puter  will  not  help  in  these  tasks  if  the  teacher  must  wait  to  use  it,  or 
if  it  is  located  Inconveniently.   Sane  school  districts  have  successfully 
SUffiD  oajputers  to  teachers  to  use  at  hane.  Intending  thus  both  to  solve  the 
problem  of  aoxss  and  to  aim  for  transfer  of  resulting  skills  to  dassroans. 

On  a  higher  level,  the  Ijtpact  of  technology  m  teachers'  professiaial 
work  remains  to  be  felt.  Efforts  have  been  made  to  enosurage  professiova 
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Interchange  among  teaciiers  using  buUetin  board  programs  (e.g.,  Harvard 
ETC's  C30B|uter  Oonferendng  Project— see  Educatieanal  Ttedinology,  1988) . 
l*"ch«>orl€nted  ooiiuter  software  to  si^^xart  collaborative  evaluation  and 
research  are  not  yet  ocnnon,  hut  the  flurry  of  interest  in  tools  to  aid 
a»|Mter-based  ooUaborative  work  in  business  (e.g.,  DeSanctis  &  Gallupe, 
1987)  nay  lead  to  more  interest  in  creating  sudi  programs  for  education. 

Technological  systems  for  gathering,  collating,  analyzing,  and 
disseminating  data  about  student  performance  could  also  help  to  make 
teachers'  work  more  professional.   Bart  of  this  process  begins  in  teacher 
training,  vbare  students  are  not  now  ccnnnonly  urged  to  become  what  Richard 
Elinore  calls  ••voracious  producers  and  consumers  of  information"  about  all 
aspects  of  school  performance  (personal  oomraunication,  JVdy,  1988) .  Neither 
are  most  teachers  now  given  the  cpportunity  to  develop  such  skills  in  their 
daily  life,   m  many  school  districts,  student  performance  data  are  k^ 
relatively  secret  not  only  to  provide  confidentiality  for  student  records, 
but  also  to  protect  administrators  and  principals  ftom  potentially 
•nbarrassing  inquiries  regarding  problems  in  teaching  and  learning, 
•'disproportionality  in  achievement  by  students  from  different  SES  or  ethnic 
bacikgrounds,  etc.   Tedmology  can  break  such  barriers  and  Improve  the 
circulation  of  Infonnation  both  for  the  assessment  of  individual  student 
needs  and  (more  iaportanUy)  to  allow  teachers  as  professionals  to  ••take  the 
terrperature^^  of  the  systems  in  which  thej-  work.  Moving  to  such  an 
informaticn-based  professional  culture  is  not  likely  to  be  easy;  it  is  a 
problem  faced  hy  many  orga.Tization'i  under  today^s  of  rapidly  spreading 
technology  for  creating  and  disseminating  information  on  which  management 
decisions  can  and  must  be  made  (see,  for  exanple,  Zuboff 's  [1988]  excellent 
treatment  of  mxii  effects  in  industry) . 
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IteflJoviaHtaiLa  <n  p>y^rrh  ?n  tflaehi«i-wlth--technoloay.   Pesearch  on 
technology  In  education  is  inproving,  but  many  changes  in  both  method  and 
assunptions  are  necessary,   niere  is  now  a  strcaig  consensus  that  technology- 
aa-harAnre  does  not  ehhanoe  student  learning  (Clark,  1983) .    Gne  needed 
Bgpeoadi  is  an  eaophasis  on  field  esqjerlments  and  a  ocnparative  examination 
of  the  ^plication  of  technology  in  ways  that  are  sensitive  to  differences 
in  context  (Becker,  1988).   others  (e.g.,  Fenelman,  1987)  have  urged  an 
approach  to  research  and  evaluation  regarding  technology  so  as  to  encourage 
divarai^  among  schools,  and  thus  foster  innovation  and  change  instead  of 
bureaucracy. 

ftit  these  approaches,  while  desirable,  leave  pressing  concerns  of 
teachers  unaddressed— the  meaning  of  technology  in  their  own  day-to-day 
activity,  the  "looJc  and  feel"  of  classrocms  in  vhich  teachlng-with- 
technology  has  beccne  the  norm,  and  the  internal  habits  of  mind  that 
teachlng-with-techndlogy  iiposes  and  encourages.   While  there  have  been  scne 
Interesting  studies  (e.g.,  Olson,  1988;  Barter,  1986;  Wiste  et_aLL,  1988), 
Buch  more  needs  to  be  done.   Ihis  is  the  research  agenda  technologists  must 
grapple  with  if  they  wish  to  tate  part  in  the  second  wave  of  the  educational 
reform  movement. 

Several  specific  approaches  could  gamer  new  information  useful  both  to 
educational  technologists  and  to  policy  maters  conoemed  about  how  to 
Inplement  technology-based  programs.   One  needed  new  direction  is  increased 
enfhasis  on  estiration  of  program  feasibility,    in  a  context  v«iere  time 
demands  on  teachers  and  students  are  Increasing,  not  decreasing,  and  where 
fiscal  resources  are  limited,  educational  technologists  are  flrequently 
called  yjpcn  to  estimate  not  just  the  costs  of  a  prmjidm  or  the  lUoellhood  of 
its  overall  success,  but  rather  the  probability  that  it  will  mate  some 
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mamxnblm  and  valuable  oontrlbuticn  to  the  overall  ecJucational  program  of 
the  school  or  district,   uaucational  technologists  should  also  be  able  to 
mate  vaascnable  estimates  of  time  constraints  and  of  the  difficulty  for 
teadiers,  students,  and  administrators  of  learning  na/  systems  and  nev 


Also  crucial  istheneedtomoveawayfraathe  present  focus  on 
»««uring  lowwievBl,  shortH^m  cognitive  outomes  and  toward  an  ajproach  in 
'Ale*  IWKrnnytwmpg  in  cognitive  style  and  personal  well-being  are 
aweBsed.   ihe  oonoems  that  teachers,  administrators,  and  parents  have 
*tout  the  use  Of  ccmputers,  for  exanple,  frequently  have  to  do  not  only  with 
H-nedlate  learning,  but  also  with  more  general  and  long-lasting  patterns  of 
thougjht  and  action.   J^rents-  fears  that  their  children  will  develop  to  be 
oa.|«ter  "hackers- fau  into  this  cate^^ 

t«m  ii,l«±  Of  intensive  use  Of  computerized  work  environm^  or  of 
exposure  to  television  (see,  e.g.,  Ong,  1982;  Msyrowitz,  1985;  1999; 
Pool,  1983;  and  Itokle,  1984,  on  these  trends) . 

Radical  reform  recjuires  radically  new  ways  of  thinking  about  schoolii^. 
It  demands  that  we  recognize  the  inportanoe  of  schools  as  social 
Institutions,  and  of  teachers  as  the  agents  principally  responsible  for 
effecting  education.   Using  technology  to  define  and  strength^i  teacSiers- 
roles,  to  e,^  them  in  their  institutional  context,  to  allow  then  to  find 
and  aaplify  their  voice,  will  lead  to  a  truer  and  more  effective  linkage  of 
teaching  and  technology,  a  linkage  that  can  also  contribute  to  iiiportant 
broader  changes  now  under  way  in  education. 
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The  Relationship  Between  Elementary  Teachers*  Psychological 
Types  and  Their  Uses  of  Educational  Computing 


PURPOSE 

Many  factors  operate  within  a  school  to  detemiine  both  the  quantity  and  quality  of  a 
student's  computing  experience;  one  critical  factor  is  the  classroom  teacher  (Knupfer,  1987a. 
1987b).  The  influx  of  microcomputers  into  American  schools  has  been  viewed  differently  among 
teachers,  leading  some  teachers  to  use  computers  with  their  students  while  others  do  not. 
Further,  teachers  who  do  use  educational  computing  do  so  in  a  wide  variety  of  ways. 

Because  the  teacher's  role  Is  central  in  detenmining  a  studenrs  computing  experience, 
the  field  needs  to  be  able  to  specify  fadori  which  make  one  teacher  an  enthusiastic  user  of 
educational  computing  while  another  teacner  refuses  to  use  the  technology.  One  factor  which 
might  influence  teachers'  decisions  about  using  computers  and  further,  the  type  of  usage  they 
employ,  is  their  "psychological  type."  Although  many  studies  have  investigated  psychological 
type  as  a  factor  in  career  decisions  and  group  dynamics,  none  have  explored  it's  impact  on 
teachers'  dedsion-maldng  processes  within  the  areas  of  instnictional  computing. 

The  objective  of  this  study  was  to  investigate  the  relationship  between  elementary 
teachers'  "psychological  types"  and  their  uses  of  instructional  computing.  "Psychological  type" 
was  detennined  by  the  Myers-Brfggs  Type  Indteator  (MBTI),  a  standardzed  instmn  ent  developed 
to  help  understand  how  people  perceh^e  experiences  and  decide  what  to  do  about  them.  .Uses 
of  instructional  computing  were  detenrrined  by  teacher  inlen/iews  and  logs  of  students'  computer 
usage. 

The  researcher  sought  first  to  determine  if  there  was  any  relationship  between  the 
teachers'  "psychological  types"  and  their  decisions  to  use/not  use  computers.  For  computer- 
using  teachers,  the  researcher  further  sought  to  detemiine  if  there  was  any  relationship  between 
particular  lands  of  computer  use  and  teachers'  "psychological  types." 

Significance 

Becfase  computers  are  playing  an  increasing  role  in  all  aspects  of  American  sodety,  it  is 
critical  that  all  students  have  some  familiarity  with  computer  technology  (Bartx)ur,  1989). 
However,  some  teachers  refuse  to  use  corriputers,  causing  their  students  to  miss  the 
opportunity.  I^ck  of  opportunity  to  use  computers  may  be  particularly  damaging  to  minorities, 
young  women,  cr  less  well-behaved  students  who  have  tradMonally  had  less  access  to 
technology  (Edwards,  1984;  Komosid,  1983;  Lautenberg,  1984;  Nathan,  1983;  Schubert  & 
Baldte,  1984).  In  planning  for  instnictional  computing  teachers  need  to  consider  equity  fdr  those 
student  groups  as  well  as  for  students  of  different  abifity  groups. 

One  step  toward  promotion  of  equitable  euucational  oortipuiing  is  io  provide  teacher 
education  based  on  a  better  understancHng  of  the  machine/human  interface,  induding  the 
dynamics  of  teachers'  dedsion-making  about  'v^mputer  use.  This  study  investigated 
psychological  type"  as  a  factor  which  might     ence  teachers'  dedsions  about  computer  usage. 
It  further  proposed  to  allow  infomnation  aboi    ^cmctional  conoputing  to  emerge  through  teacher 
intenriews.  The  resulting  factors  which  influeiice  teachers'  dedsions  can  be  considered  in 
developing  training  programs  for  preservice  and  insenrice  teachers.  Such  training  might  be 
designed  according  to  the  MBTI  suggestions  for  accommodating  individual  learning  and  teaching 
styles  (see  Myers,  1975). 
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LITERATURE  REVIEW 

Several  studies  have  documented  teachers'  or)going  confusion  about  how  to  integrate 
computers  into  the  traditional  classroom  stmcture  and  resulting  inequities  in  students'  conning 
experiences  (Alvarado,  1984;  Andeison,  Welch  &  Hanis,  1984;  Becker,  1986;  Edwards,  1984; 
Jungck,  1985;  Knupfer,  1987b;  Lesfjoid  &  Reif,  1983;  Schubert  &  Baldce,  1984;  Sheingold, 
Kane,  Endreweit,  &  Billings,  1981).  iDuantrtative  inequity  prevails  when  the  machines  are  not 
available  and  qualitative  inequity  results  from  differences  in  the  type  of  instmctional  use  (high  sidii 
level  and  low  skill  leveO  to  whtoh  students  are  exposed.  If  low-level  activities  encourage  rote 
memorizatton  under  the  control  of  the  program,  and  high-level  activities  promote  independent 
thinking  and  stimulate  curiosity,  th(»n  the  degree  of  the  learners  exposure  to  these  techniques 
can  either  stunt  or  improve  their  cognitive  abiities  (Knupfer,  1987b;  Patterson  &  McLellen,  1986). 
The  selectton  of  instructional  activities  therefore,  can  promote  or  retard  the  learner's  heuristk:, 
cognitive  devetopment,  putting  a  premium  on  assuring  not  only  equal  access  to  computers  for  all 
students,  but  also  on  equal  access  to  the  cSfferent  kinds  of  educattonal  computing  activities. 

The  method  by  whtoh  any  innovation  is  implemented  is  signifteantly  more  important  than 
the  actual  sul)iect  of  the  implementatton  in  determining  the  innovatton's  success  (Berman  & 
McLaughRn.  1976).  It  follows  that  the  way  computers  are  used  is  more  important  than  the  fact  that 
the  machines  are  sitting  in  school  buildings.  Recent  research  has  shown  that  a  final  arbiters  of 
classroom  activities,  regardless  of  administrative  mandates,  teachers  will  shape  any 
implementatton  effort  to  fit  their  own  situations  (Cuban,  1986;  Fullan,  1982;  Jackson,  1978; 
Weinshank.  TrumbuH,  &  Daly,  1983). 

A  study  of  teachers'  reactk>ns  to  instiucttonal  computing  (Knupfer,  1987b)  revealed  that 
less  than  30%  of  the  elementary  teachers  used  computers.  Further,  teachers  beBeved  that 
average  and  remedial  students  were  limited  to  sofhrare  whtoh  promoted  low-level  thinking  skills, 
while  advanced  students  used  the  computer  mostly  to  promote  the  higher-level  thinking  skills.  In 
spite  of  common  complains  of  time  shortage,  inadeiquate  training,  poor  software,  and  lack  of  both 
equipment  and  program  objectives,  Knupfer  found  that  there  *v^re  some  teachers  who  attempted 
instmcttonal  computing  while  other  teachers  flat  out  refused,  ixnupfer  suggested  a  need  to 
investigate  factors  whtoh  might  influence  teachers'  dedstons  to  use  or  not  use  instmcttonai 
computing. 

One  measure  of  the  way  people  make  judgments  and  dedstons  is  the  Myers-Briggs  Type 
lndicator.{MBTI).  This  instmment  is  based  on  the  woik  of  Carl  Gustav  Jung,  who  published 
Psycholojgical  Types  in  1921  as  a  way  of  helping  people  to  understand  themselves  and  others 
(O'Brien,  1985).  According  to  Jung,  people  differ  in  their  perceptton  and  judgment  styles. 
Perception  is  the  way  they  become  aware  of  things  and  judgment  is  the  process  of  reaching 
conclusions  about  those  things.  People  can  perceive  things  in  two  distinct  ways,  by  sensing  or 
by  intuiiing.  Sensing  individuals  tend  to  prefer  concrete  facts  and  are  good  with  details,  while 
intuiung  peopie  tend  io  be  more  creative  and  oisiike  routine.  People  are  also  able  to  make 
judgments  through  two  distinct  methods,  thinking  and  feeling.  Thinking  people  evaluate 
Infonnation  In  an  impersonal,  logical  fashion,  while  feeling  people  evaluate  information  on  the 
basis  of  values. 

Isabel  Briggs  Myers  and  Katharine  C.  Briggs  expanded  on  Jung's  theory  and  In  1943 
constmcted  the  four  dimensional  MBTI  to  measure  type  preferences  (Myers,  1962).  Among 
other  things,  the  MBTI  has  been  used  to  study  groups  of  people  (Graves  &  Graves,  1973).  the 
performance  of  school  principals  (Brightman,  1984),  teachers'  behavtor  (DeNovellis  &  Lawrence, 
1983),  and  student  achievement  (Myers  &  McCaulley,  1985).  Although  various  researchers  have 
used  the  MBTI  to  study  teachers  and  some  have  even  tried  to  change  the  teachers' 
''psychok)gk:al  types"  through  directed  InstmcUon  (Dettmer,  1981),  no  one  has  Investigated  the 
relationship  between  teachers'  "psychok)glcal  types"  and  their  reaction  to  instmctional 
computing. 


252 

255 


MBTI&  Computer  Use  3 


METHOD 

Subjects 

^  „  were  sixty  elementary  (K-6)  school  teachers  who  teach  on  a  full-time  t)asis 

across  the  general  curriculum.  The  teachers  represented  three  schools,  all  within  the  same 
genera^^  neighborhood  and  with  the  same  socio-economic  status.  Each  school  had  a  larae 
'^Sli  "P"^'  ^^^^^    Chapter  I  funding.  After  a  decision  from  the 

P„"tM  2?  5?  teachers- "computer  committee-,  all  teachers  (29)  from  one  school  were  included 
in  the  sttjcty  The  researcher  solicited  volunteers  from  the  other  two  schools:  the  second  school 
had  a  sizable  number  (21)  and  the  third  school  had  the  tewest  (10). 

MatBrtala 

Myen-Brigga  Type  Indicator  (MBTI)  ~  The  MBTI  is  a  questionnaire  used  widely  in 
CMnseling.  psychology,  and  education  to  determine  "psychologjcal  type."  The  essence  of  the 
mlJl  'jJi^J*''^^'*  are  influenced  by  the  way  in  which  people  prefer  to  take  in  information  and 
maKe  decisions.  Four  preference  types  are  measured:  1)  Extroversion/Introversion  (attitude 
■^.T^l^A^'S!^!^"'      "'^    perception):  3)  ThinWng/Feelng  (SS>  WnT? 
?S?HLSS'  -*)  iH?0'^erceptive  (attitude  for  dealing  with  the  environment)  (see  Rgure  IV 

li^o^^'^'!^^^'^?^^^^  ^'^"O  the  1940s  and  revalidated  in  1977.  is  both  reHable 
(90%)  and  vaid  (Myers.  1975). 

The 'nstmment  categorizes  people  into  16  diflerert  types  based  upon  acorns 
thefourscales  (see  Figure  2).  The  MBTI  is  not  meant  to  steribtype  peopSVtoinSeft^^^^ 

^S^i^XfL^XT'^^'^'^-  EachtypeSSScharJJteiSto^ 
^^JZ^l^^'S^lS^'S!!!!^^'^'^  lnanypracticalsense.ltwoi«bedWfSltto 
^^rJi  N^^1^?«  "5.'!!!  y^'^J^  types-  When  planning  teacher  traliSrvi  within  any 
one  school  building,  so  tWs  study  focused  on  the  four  main  variables  that  comprise  the  !6  types. 

eh«-        ^^"^   I"®  '"strument  contain  126  (Fbrm  G)  or  166  (Form  F)  questions.,  and  a 
2^Jt'?i*^'*'"I®'^"i'*i?"  >^<Hih  the  slSer  version?  self 

the  standard.  The  subtle  questions  indirectly  tease  out  the  type  preferences  through  forced- 
choice  answers  between  two  possibl'i  responses.  'WVWM- 

.n,r.rmJT^M  "  V"Stmctured  Inten/iews  (Guba  &  Uncoln,  1981)  with  the  teachers  elicited 
infonTiaJion  about  decisions  regarding  computer  use.  The  interviews  included  a  set  of  common 
questions  to  sen^e  as  a  base,  such  as  "What  effect  has  educational  computing  had  on  the 
com^ t?ngr°"^  ^       ^  "™  problems  youve  had  with  instructional 

H..«ti«n^I!?t?L'f  ^*  Z  Student-maintained  logs  of  computer  activity,  including  the  frequency. 

^S:f^J'^Jii^,Z^'^'^'^^'^^^^^'^^^^^'-  Whenusingcourseware,tt)e 
students  noted  ttie  title  of  ttie  courseware  and  what  they  did  on  the  log.  The  researcher 

J«SSxn7w''-r^  l^""''^  '^T^''^^  high-leveO  the  courseware  represented.  The  logs 
2?!!?  u!^!'  ^  students'  computer  use,  which  could  be  conpared  to  teachere' 

beuefs  about  that  use. 

Hypothaala 

-     K  P^*  fsearch  tested  the  null  hypothesis  that  there  is  no  relattonship  between  teachers' 
psychological  types"  and  their  reaction  to  Instmctional  computing.  Reaction  Included  ttie 
teachers  dedstoris  to  use  or  not  use  computers,  ttieir  participation  In  training,  ttieir  attitudes 
about  computers  in  the  schools,  and  the  kinds  of  educational  computing  utilized. 

Proeadura 

'n  order  to  gain  access  to  the  schools  tor  this  study,  ttie  researcher  traded  ttie  opportunity 
to  do  research  tor  computer  )nsen/ice  presentations  at  each  school  involved;  each  principal 
decided  whether  to  have  one,  two,  or  ttiree  insen/tee  sessions.  The  study  itself  was  conducted 
over  the  full  course  of  the  second  semester  and  culminated  during  ttie  last  week  of  school 
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The  MBTl  was  administered  to  all  teacher  participants  in  mass  at  each  of  the  three  schools. 
The  researcher  gave  thn  teachers  an  overvtev^  of  the  MBTl  and  told  them  that  the  instmment 
would  help  Indicate  how  they  made  judgments  and  decisions,  including  their  decisions  about 
their  jobs  as  teachers.  The  MBTl  should  not  be  administered  without  some  sort  of  explanation,  so 
the  researcher  was  allowed  approximately  an  hour  to  conduct  a  training  session  about  the  MBTl 
and  how  teachers  could  used  their  knowledge  of  "psychological  type"  to  enhance  their 
relationships  with  fellow  employees. 

The  researcher  instructed  the  teachers  about  maintenance  of  the  student  computer  logs, 
and  the  teachers  explained  the  logs  to  their  students,  reminding  them  periodically  to  maintain  the 
logs  throughout  the  semester.  A  log  was  attached  to  each  computer,  so  that  if  the  computer 
moved,  the  log  went  with  it.  The  researcher  monitored  the  logging  of  computer  activity  as  much 
as  possible,  but  could  not  be  present  at  all  times. 

During  the  semester,  the  researcher  observed  each  teacher  conduct  a  lesson  and 
engaged  In  an  Interview  with  each  teacher.  The  inten/iew  information  and  the  student  log 
inforrnation  was  compared  to  the  four  MBTl  dyads  and  analyzed  for  statistical  significance. 

Data  Analysis 

The  data  analysis  first  employed  chl-square  tests  of  Independence  to  evaluate 
relationships  between  teachers'  use/nonuse  of  edr^cational  computing  and  "psychological  type." 
Then  among  teachers  who  used  educational  computing  with  their  students,  the  chi-square 
statistic  tested  relationships  between  the  teachers'  "psychological  type"  and  patterns  of  computer 
utilization.  Data  from  the  interviews  were  grouped  according  to  emergent  categories,  reported 
with  summary  statistics,  and  then  analyzed  with  the  chi-square  statistic  when  appropriate. 
Several  questions  which  measured  positive  attitude  on  a  Likert-type  scale  were  grouped  together 
and  a  t-test  was  conducted  to  check  for  (fifferences  in  the  means.  For  all  tests,  signifk:ance  was 
set  at  the  .05  level. 

RESULTS 

Of  the  sixty  subjects  in  this  study,  58  were  present  to  take  the  MBTl.  One  did  not  want 
the  results  revealed  to  anyone,  including  the  researcher,  so  there  are  57  valkl  cases.  The 
frequency  dtetributton  of  MBTl  categories  is  reported  in  Figure  3. 

Contingency  tables  were  constnjcted  and  chi-square  tests  on  each  MBTl  dyad  (E-l,  S-N, 
T-F,  AND  J-P)  revealed  no  significam  relattonship  between  the  type  of  teachers  who  used 
instmctional  computing,  and  those  who  did  not .  However,  this  measure  is  limited  by  two  factors : 
1)  the  first  school  (29  subjects)  required  all  teachers  to  send  some  studentr  o  the  computer  lab, 
and  2)  sut>jects  from  the  other  two  schools  participated  on  a  voluntary  basis  which  might  have 
skewed  the  data  for  this  measure.  A  second  anal^s  eliminated  the  first  school  and  checked  for 
relationships  between  the  second  and  third  schools,  both  of  which  housed  the  computers  within 
ihe  classrooms;  no  sigrnflcant  relatk)nship  was  found. 

Teachers  who  used  computers  at  least  once  during  the  schooiyear  were  tested  for 
relationships  between  their  MBTl  type  and  the  kind  of  computer  use,  as  well  as  for  relationships 
between  the  MBTl  type  and  which  students  used  the  computers.  There  was  no  significant 
relationship  found  in  either  of  the  tests.  The  type  of  computer  activity  in  each  of  the  three  schools 
was  solely  drill  and  practice,  with  two  exceptions;  school  one  taught  sixth  grade  students  to  use  a 
word  processor  and  school  two  altowed  some  studer  is  to  use  some  popular  simulation  software. 
Unfortunately,  the  word  processor  use  was  not  tied  nito  the  curriculum,  so  students  did  not  apply 
the  tool  to  their  wort(..  Also,  the  students  at  school  two  usually  spent  less  than  10  minutes  at  the 
computer,  making  it  difficult  to  complete  a  simulation. 

The  chi-square  statistic  revealed  a  significant  relattonship  between  specific  MBTl  dyads 
and  several  dependent  variables:  the  amount  of  training  teachers  had  taken  through  district- 
supported  computer  classes  (with  E-l),  feeling  of  adequacy  of  training  (with  S-N),  whether  or  not 
the  principal  encouraged  computer  use  (with  S-N),  factors  whtoh  make  it  difficult  to  use 
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instructional  computing  (with  J>P),  and  opinion  about  the  quality  of  available  software  (with  J*P  and 
T-F). 

Disthct-Suppofted  Comptiter  Classes.  It  appears  that  the  majority  of  both  E  and  I  types 
had  taken  no  district  computer  classes  at  all.  but  the  percentage  of  those  who  neglected  classes 
was  larger  armng  introverts  than  extroverts.  About  one-fifth  of  the  extroverts  had  tal^en  one  class 
(see  Table  1). 

Adequacy  of  Computer  Training.  Although  sensing  and  intuiting  people  had  equivalent 
amounts  of  training,  the  feeHngs  of  adequacy  of  that  training  was  not  independent  on  the  S/N 
variable.  Most  Ss  and  Ns  believed  that  their  training  was  totally  inadequate,  but  on  the  whole  Ss 
indicated  less  satisfaction  with  their  preparation  than  Ns  (see  Table  2. 

Principars  Encouragement  to  Use  Computers.  The  reactions  of  the  teachers  to  district  or 
principal  encouragement  to  use  computers  is  significantly  recited  to  their  S-N  type.  A  larger 
percentage  of  Ns  reported  either  no  encouragement  all  or  encouragement  through  training 
opportunities  within  the  district,  while  a  large  percentage  of  Ss  claimed  that  the  district  or  prindpal 
encouraged  computer  use  try  providing  hardware  or  software.  In  other  words,  the  Ns  perceived 
themselves  as  receiving  little  support,  but  if  they  wanted  training  they  could  seek  it  through  district 
computer  classes.  Ss  beloved  there  was  more  tangibte  support  offered  within  their  innmediate 
work  situatton  (see  Table  3). 

Factors  Which  Make  ft  CHfflcuii  to  Use  Comnutera.  Judging  and  perceptive  people  did  not 
agree  on  the  things  that  make  it  hard  to  use  computers  within  a  school  setting.  Table  4  shows  a 
significant  relationship  the  teachers'  J-P  type  and  their  answers  regarding  obstacles  to 
Instructtonal  computing.  The  majority  of  judging    ipie  believed  that  the  computer  lacks 
meaning  within  the  curriculum,  while  the  largest .    ^mms  among  perceptive  people  revealed 
access  to  equipment  (both  hardware  and  softwaid;    the  largest  deterrents  to  computer  use 

Quality  of  Educational  Software.  The  teachers'  responses  to  the  quality  of  educattonai 
software  showed  a  signiftoant  relattonship  between  their  viewpoints  and  both  the  J-P  and  T-F 
MBTI  dyads.  Most  judging  people  and  feeing  people  claimed  that  educattonai  software  is  of  good 
quaity.  while  a  large  percentage  of  perceptive  people  and  thinking  people  belie/ed  that  they 
were  unc^alfied  to  answer  the  questk>n.  In  other  words,  the  perceptive  people  and  thinking 
people  dkJ  not  know  what  to  think  of  the  quality  of  educational  software,  while  the  judging  people 
used  logic  and  the  feeling  people  used  values  to  determine  that  the  software  was  of  qoo6  quality 
(see  Tables  5  and  6). 

Fmally,  differences  in  the  means  of  the  teachers'  positive  attitude  toward  computers 
based  on  their  MBTI  types  was  measured  for  significance  with  a  t-test.  The  test  revealed  that  the 
mean  was  slightly  more  positive  than  neutral  for  each  group;  no  group  w^s  very  positive  and  no 
group  was  very  negative.  There  were  no  significant  differences  in  degt^e  of  positive  attitude 
between  any  of  the  MBTI  types. 

According  to  observations  and  teachers  inten/iews,  the  school  principal  was  the  most 
influential  person  in  determining  how  confers  were  used  in  each  school.  The  principal  was 
responsible  for  encouraging  and  provkjing  direction  for  computer  use.  Each  principal  made 
decisions  about  how  computer  resources  would  be  acquired  and  distributed  among  teachers  and 
students.  And,  the  degree  of  faculty  and  staff  involvement  ctosely  reflected  the  principars 
direction. 

The  first  school  had  a  prindpal  who  actively  promoted  computer  usage  for  all  students. 
Although  the  majority  of  the  computer  resources  were  purchased  with  Chapter  I  funds,  the 
principal  placed  the  computers  in  a  laboratory  setting  and  encouraged  all  teachers  to  send 
students  to  use  the  lab  on  a  weekly  basis.  This  principal  established  a  committee  of  teachers  to 
deal  with  computer-related  issues  and  actively  sought  the  committee's  recommendatton  prior  to 
making  final  decisions.  Teachers  in  this  school  beloved  ttiat  the  principal  actively  helped  them  tc 
learn  about  computing.  This  principal  welcomed  the  researcher  and  encouraged  the  researcher 
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to  get  invoived  with  the  schoors  computer  curriculum.  The  principal  planned  to  Increase  each 
teacher's  lab  time  from  one  20-minute  session  per  week  to  two  20*minute  sessions  per  week 
during  the  next  school  year  The  major  factor  inhibiting  the  teachers*  Involvement  with 
Instructtonal  computing  was  the  lab  situatton.  White  the  lab  aide  conducted  the  computer 
sessions  with  a  partial  dass  of  students,  the  teachers  kept  the  remaining  students  in  the 
classroom  or  completed  other  duties.  The  teachers  did  not  feel  motivated  to  sharpen  computer 
skills  because  they  believed  they  wouM  not  need  the  skills  nor  get  a  chance  to  use  the  skills  with 
their  students.  As  a  result,  the  computer  lab  operated  withou.^  the  benefit  of  currtoukjm 
coordinatton  with  the  classroom  activities.  The  researcher  conducted  three  Insen/ice  training 
sessions  for  the  teachers  at  tNs  school.  All  weie  well-attended;  probably  because  the  principal 
was  trying  to  get  additional  computers  to  place  within  classrooms  for  the  fbitowing  year. 

The  principal  at  the  second  school  dd  not  seem  very  supportive  of  the  computer 
cunlculum.  That  principal  was  not  available  to  meet  with  the  researcher  and  dM  not  have  a  plan  to 
help  teachers  use  the  computers  with  the  students.  The  computers  were  dtetributed  among  the 
classrooms  so  that  each  grade  level  (three  classes  of  approximately  30  students)  shared  one 
computer.  There  was  a  imited  supply  of  software  which  was  housed  in  the  ibrary/media  center 
with  hopes  that  it  wouM  be  available  torteachers  to  check  out.  Unfortunately,  the  software  was  in 
a  state  of  chaos,  with  no  organizatfon  and  no  dear  instmcttons  for  teachers  about  the  content  or 
workings  of.the  soflw&e.  Most  teachers  were  very  hesitant  to  exptore  the  computers  or  softw-^re 
ontheirownanda8aresutt.thea>mputerswereusedbyalmitednurnberofclassiw  The 
method  of  dtotributing  one  computer  per  grade  level  might  be  sound  in  theory,  but  in  actual 
practtoe  this  method  aHowed  some  of  the  computers  to  remain  totally  unused  fbr  the  schoolyear; 
few  of  the  teachers  in  this  school  sought  a  computer  with  gusto.  One  teacher  beleved  the 
computer  in  her  classroom  didnl  woric,  but  the  researcher  fbund  that  it  was  not  plugged  in  and  the 
teacher  dd  not  know  how  to  insert  a  dsk.  In  a  similar  situatton,  a  teacher  knew  there  was  a 
computer  to  share  among  three  classrooms,  but  dM  not  reaSze  that  it  had  been  in  her  classroom  all 
year  (nor  dkJ  her  two  colleagues  know  which  room  it  was  in  since  they  had  no  interest  in  using  it). 
The  researcher  planned  to  conduct  two  inservtoe  training  sessions  in  the  spring,  but  due  to 
demoraBzatton  of  the  teachers,  that  dd  not  happen.  A  large  number  of  teachers  came  to  the  first 
sesston,  but  only  to  announce  that  there  was  no  point  in  receiving  the  training.  The  prindpal  had 
dedded  to  use  a  lab  situatton  the  foHowing  schootyear  and  restrict  the  computers  to  Chapter  I 
students,  who  wouU  be  supen^  by  one  aduK  Of  course,  the  teachers  were  demoralized.  This 
was  parttoulariy  dsappointing  in  contrast  to  the  original  enthusiasm  of  the  staff  when  they  first 
volunteered  to  help  with  the  research  on  instmcttonal  computing. 

The  third  school  in  the  study  enjoyed  a  prindpal  who  supported  instructtonal  computing 
by  setting  an  example  for  vtudents  and  teachers.  This  prindpal  altowed  students  to  use  the 
computer  in  the  school  office  as  a  reward  for  school  accomplishments,  academk:  or  behavioral.  A 
teacher,  who  had  been  assigned  as  the  computer  spedalist,  supen/ised  rotation  of  the  software 
and  hardware  amorig  classrooms.  That  teacher  also  conducted  two  insen/ice  sessions  per  year 
and  was  avaiiduie  for  iridvkjuai  consuifirig  on  a  daiiy  basis,  me  ieachefs  in  this  schoo!  seemed 
split  on  their  level  of  enthusiasm.  A  particular  group  of  young,  enthusiastic  teachers  volunteered 
to  partidpate  with  the  study,  but  several  teachers  who  chose  not  to  use  computers  also  chose  not 
to  partteipate  in  the  study.  The  prindpal  and  the  computer  spedalist  dedded  to  put  the 
computers  in  a  lab  during  the  next  year  and  provMe  software  via  a  networi(ed  system. 

It  appears  that  more  teachers  beleve  their  students  are  using  computers  than  is  the  case. 
This  is  evMenced  by  the  fad  that  14  teachers  adnrMed  not  using  computers  at  c  i  duri.ig  the 
school  year,  but  the  student  togs  revealed  that  22  teachers  did  not  send  students  to  the 
machines.  Pertiaps  teachers  ieel  that  they  must  claim  a  willingness  to  send  students  to  use 
computers,  if  that  is  not  the  case,  then  pertiaps  students  were  forgetting  to  fill  out  the  tog  sheets. 
In  any  case,  students  were  not  getting  any  hlgh^evel  use  of  computers  in  any  of  these  three 
schools.  All  exerdses  dealt  with  mnning  drill  and  nractice  software,  or  leaming  to  manipulate  a 
word  processor,  but  not  actually  using  the  word  processor  tor  produdive  purposes.  Only  one 
teacher  fett  well-enough  bx  ^ed  to  incorporate  computers  into  the  cunicuium  at  ail;  the  others 
simply  had  the  students  mn  drill  and  practice  software  that  was  unrelated  to  their  classroom  wort<. 
Only  two  teachers  adually  had  all  of  their  students  use  computers  during  some  point  in  time.  The 
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pattern  of  student  usage  indicates  that  the  teachers  are  letting  advanced  and  average  students 
use  the  computers  more  than  the  remedial  students,  but  that  not  all  average  and  advanced 
students  in  a  classroom  use  the  computers  either.  Rather,  the  most  popular  method  of  allowing 
usage  was  to  select  specific  students  from  among  the  class  to  use  the  computer.  Those  specific 
students  were  usually  those  who  had  their  other  work  completed,  and  the  computer  activity  was 
not  coordinated  with  classroom  work.  These  general  patterns  carried  across  all  three  schools  and 
al  MBTI  types. 

CONCLUSIONS 

The  principal  is  a  very  influential  to  the  course  of  instructtonal  computing.  The  principal 
not  only  ?rckes  dedstons  whtoh  affect  the  students  and  computer  equipment,  but  which  also 
greatly  affect  the  teachers  and  their  attitudes  toward  instructional  computing.  A  supportive, 
inform^xi  principal  is  needed  to  promote  and  maintain  enthusiasm  for  instructtonal  computing 
among  the  teachers. 

There  is  a  need  to  find  a  way  to  help  introverts  get  started  with  district  computer  classes. 
Introverts  ike  thinking  about  kleas,  so  training  for  them  might  consist  of  several  problems  or 
meaningful  challenges  to  complete.  Such  meaningful  training  does  not  simply  lecture  or  deal  with 
the  abstract,  but  involves  the  learner  in  the  learning  process.  Also,  pay  particular  attenlton  to 
making  the  training  meaningful  to  sensing-type  people.  These  people  need  to  feel  that  the 
training  is  worthwhile  in  terms  of  the  curricukjm  as  weH  as  their  abiBty  to  master  the  manipulaltons  of 
the  hardware., 

Although  sensing  people  feel  that  access  to  h^vdware  and  software  are  helpful,  the 
intuitive  people  will  need  more  than  just  equip^nt*  School  districts  will  need  to  make  sure  to 
provide  training  that  is  specific  to  the  equipment  and  software  that  they  are  placing  in  the  schools 
so  that  intuitive  people  will  feel  comfortable  using  that  equipment. 

Teachers  need  training  in  software  evaluation  so  that  they  can  teH  good  software  from 
poor  software.  They  also  need  training  in  incorporating  the  computer  into  the  cunlculum  so  that  it 
can  be  used  meaningfully.  Without  such  direction  we  will  probably  see  teachers  continue  to  send 
students  off  to  computers  to  mn  k)w-level  software  and  never  take  advantage  of  the  opportunity 
to  ink  the  computers  to  their  classes  in  a  meaningful  way. 

Constnjct  a  better  way  to  obsen/e  actual  student  usage  of  the  computers  so  that 
informatton  can  be  collected  in  a  more  systematic,  accurate  manner.  This  study  was  able  to  show 
that  teachers  do  tend  to  send  students  of  mixed  abiBty  to  use  computers,  but  that  access  is  often 
based  on  getting  other  worti  finished  first.  Although  there  is  no  significant  test  of  this,  the  trend  is 
obvtous  within  the  student  log'^  and  the  teachers'  inten^ews.  In  order  to  provkle  equitable  access 
to  instnjctional  computing,  teacheiB  will  need  to  consider  both  the  quantity  and  qualty  of 
students'  time  at  the  compiner.  And  to  enable  teachers  to  do  so  means  supporting  teachers  with 
meaningful  training. 

The  kleal  situation  might  include  specific  training  technk^es  aimed  at  particular  MBTI 
types,  but  in  reality  that  will  probably  have  Bttle  chance  of  being  addressed..  An  allemative  is  to 
realize  that  teachers  do  have  different  MBTI  types  which  affect  their  judgments  and  dedstons 
about  instructtonal  computing.  When  possible,  con^der  the  relattonships  revealed  as  significant 
in  this  study  and  direct  training  to  accommodate  the  dttferent  preferences,  rather  than  just  one. 
Fdr  example,  trainers  need  to  realize  that  S  types  need  to  be  taught  how  to  generaize  beyond 
immediate  facts,  that  N  types  need  to  become  wore  accepting  of  traditional  methods,  that  S  and  P 
types  respond  well  to  rewards,  and  that  N  types  need  to  be  coached  to  pay  more  attention  to 
detail  (Myers,  1 975).  Myers  also  found  that  different  MBTI  types  respond  differently  to  different 
styles  of  instruction,  so  trainers  need  to  balance  their  method  of  deOvery  between  Bmners, 
Gagne's,  and  Ausubel's  methods  if  they  are  to  address  a  mixed  group  of  MBTI  types.. 
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Figure  1  -  Four  Myers-Briggs  Dyads 
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Figure  2  -  Sixteen  Myers-Briggs  Combinations 
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Table  1  -  Number  of  Difitrict  Computer  Classes  by  E/l 

COUNT 
EXPECTED 

COLUMN  %  EXTROVERT  (E)       INTROVERT  (I) 

TOTAL  % 


DISTnlUT  CLASS 

None 

26 

21 

27.2 

19.8 

78.8% 

87.5% 

45.6% 

36.8% 

One 

7 

1 

4.6 

3.4 

12.3% 

1.8% 

Two 

0 

2 

12 

B 

0% 

8.3% 

0% 

8.3% 

COLUMN  TOTAL 

33 

24 

57.9% 

42.1% 

CHI-SQUARE -575 

SIGNIFICANCE -.05 
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Tabre  2-  Adequacy  of  Training  by  S/N 


COUNT 
EXPECTED 

COLUMN  %  SENSING  (S)  INTUITION  (N) 

TOTAL  % 


ADEQUATE  TRAINING 

Totally  Inadequate  15  Vi 

15.2  11.8 

46.9%  48.0% 

26.3%  21.1% 

Somewhat  Inadequate         6  0 

3.4  2.6 
18.8%  0% 
10.5%  0% 

Adequate  4  10 

75  6.1 

12.5%  40.0% 

7.0%  17.5% 

Somewhat  Adequate  2  0 

1.1  3 
6.3%  0% 
3.5%  0% 

Very  Adequate  5  3 

45  35 

15.6%  12.0% 

8.8%  12.0% 


COLUMN  TOTAL  32  25 

56.1%  43.9% 

CHI-SQUARE  -  1 0.70  SIGNIFICANCE  -  .03 
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Table  3  -  is  Computer  Usb  Encouraged?  by  S/N 


EXPECTED 

COLUMN  %  SENSING  (S)  INTUITION  (N) 

TOTAL  % 


IS  COMPUTER  USE 

ENCOURAGED? 

NotAtAI 

4 

9 

73 

5.7 

12.9% 

37.5% 

7.3% 

16.4% 

Computers 

21 

8 

Available 

16.3 

12.7 

67.7% 

33.3% 

38.2% 

14.5% 

Training 

6 

7 

Offered 

73 

5.7 

19.4% 

29.2% 

10.9% 

12.7% 

COLUMN  TOTAL 

31 

24 

56.4% 

43.6% 

CHI-SQUARE  -  7.05  SIGNIFICANCE  -  .02 
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Table  4  •  What  Makes  it  Hard  to  Use  Computers  by  J/P 


COUNT 
EXPECTED 
COLUMN  % 
TOTAL  % 


MAKE  IT  HARD 


JUDGING  (J) 


PERCEPTIVE  (P) 


Do  Not  Know 

4 

5 

S.6 

3.4 

11.4% 

23.8% 

7.1% 

8.9% 

A0C6SS 

12 

7 

11.9 

7.1 

34.3% 

33.3% 

21.4% 

12.5% 

Meaningful 

16 

2 

Training 

11.2 

6.4 

45.8% 

9.5% 

28.6% 

3.6% 

Space 

0 

2 

1.3 

B 

0% 

9.5% 

0% 

3.6% 

Tune 

3 

5 

5.0 

3.0 

8.6% 
5.4% 


23.8% 
8.9% 


COLUMN  TOTAL 


35 

62.5% 


21 

37.5% 


CHI  SOUAHE"  12.13 


SIGNIFICAr>lCE-.03 
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Table  5  •  Opinion  of  Software  Quality  by  J/P 


COUNT 
EXPECTED 

COLUMN  %  JUDGING  (J)  PERCEPTIVE  (P) 

TOTAL % 


SOFTWARE  QUALITY 

Do  Not  Know  6  9 

93  5.7 

17.6%  42.9% 

10.9%  16.4% 

Terrible  2  4 

3.7  2.3 

5.9%  19.0% 

3.6%  7.3% 

Good  19  7 

16.1  9.9 

55.9%  33.3% 

34.5%  12.7% 

Excellent  7  1 

45  3.1 

20.6%  4.8% 

12.7%  1.8% 

COLUMN  TOTAL  34  21 

61.8%  38.2% 


CHI-SQUARE -8.71  SIGNIFICA.>ICE  -  .03 
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Table  v  Opinion  of  Software  Quality  by  T/F 

COUNT 
EXPECTEC 


COLUMN  % 

THINKING  (T) 

FEELING  (F) 

TOTAL  % 

SOFTWARE  QUALITY 

Do  Not  Know 

7 

8 

6.0 

9.0 

31.8% 

24.2% 

I&.f  To 

iii 

1  H.P  /o 

Territile 

5 

1 

2.4 

3.6 

22.7% 

3.0% 

9.  I/O 

i  IMC 

Good 

6 

20 

10  4 

27.3% 

60.6% 

10.9% 

36.4% 

Excellent 

4 

4 

3.2 

43 

18.2% 

12.1% 

7.3% 

7.3% 

COLUMN  TOTAL 

22 

33 

40.0% 

60.0% 

CHI-SQUARE -8.40 

SIGNIFICANCE -.03 
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The  Effectiveness  of  a  CBI  Program  on 
Problem  Solving  Abilities  of  Middle  Grade  Students 


Problem  Solving 

Problem  solving  is  a  complex  set  of  interdisciplinary 
skills  and  abilities  that  education  has  identified  as  a  critical 
instructional  topic.    It  has  been  identified  as  a  subset  of  critical 
thinking  that  uses  creative,  conceptual,  and  thinking  skills  in 
unfamiliar  situations  (Feldhusen  &  Treffinger,  1977;  Hoelscher, 
1984).    Educators  have  long  been  seeking  methods  of  teaching 
problem  solving  skills  to  their  students  (Bransford,  Stein, 
Dcclos,  &  Littiefield,  1986).   There  are  several  models  for 
teaching  these  skills  in  the  literature  along  with  a  myriad  of 
materials  available  on  the  market. 

The  process  approach  is  recommended  by  many  authors, 
including  Polya,  Beyer,  and  Bransford  and  Stein.    All  of  these 
authors  advocate  a  series  of  steps  that  can  be  learned  and 
applied  to  any  new  situation.    Some  suggest  teaching  problem 
solving  within  a  specific  content  area  and  teach  for  transfer  to 
other  situations,  others  suggest  using  real-life  problems  to 
solve  to  aid  in  the  learning  of  the  process. 

Computer 

There  has  been  a  recent  proliferation  of  materials 
available  for  the  microcomputer  that  claim  to  teach  problem 
solving  skills.    Why  consider  th  computer  for  teaching  probbm 
solving?    lliere  are  several  possibilities  for  suggesting  the 
computer  as  a  teaching  tool.    First,  it  can  present  real-life 
problems  that  would  be  difficult  or  impossible  without  the 
computer.    For  example,  the  computer  can  collapse  time  so  that 
students  can  see  the  results  of  their  decisions  promptly.  The 
computer  can  also  present  situations  that  would  other-wise  be 
dangerous  for  students.    Students  can  make  decisions  and  see 


the  results  without  fear  of  consequences.    The  computer  allows 
for  programs  to  be  written  to  branch  and  send  students  in 
different  directions  depending  on  the  decisions  made. 

There  is,  however,  a  lack  of  empirical  evidence  validating 
the  use  of  computer  as  an  instructional  tool  in  teaching 
problem  solving  strategies  to  middle  level  students. 

Purpose 

The  study  described  in  this  paper  attempts  to  evaluate 
the  effectiveness  of  one  of  those  computer  software  programs 
developed  to  teach  problem  solving.    Solutions  Unlimited,  a 
public  domain  software  package,  was  selected  because  it  was 
designed  to  be  a  comprehensive  program  for  developing 
probl^  solving  abilities  in  middle  level  students  and  its 
attempt  to  teach  general  problem  solving  strategies.  The 
program  follows  a  pattern  of  problem  solving  skills  similar  to 
those  recommended  by  Polya  (1957).    There  are  eight  units  in 
the  package,  the  first  being  a  tutorial  teaching  the  four  step 
process  for  problem  solving,  "Hey  Wait,"  "ITiink,"  "See,"  "So." 
The  seven  subsequent  units  ate  situational  lessons  that  give 
the  students  opportunities  to  apply  those  steps.    Use  of  real-life 
problems  help  students  to  realize  that  solutions  are  not  always 
clear  and  that  more  than  one  solution  may  offen  be  applied  to 
the  same  problem.    The  lessons  cover  topics  scch  as  considering 
alternatives,  judging  sources  of  information,  and  drawing 
conclusions. 

Investigation 

Fifty -one  middle  level  students  attending  a  private  school 
in  a  small  community  in  the  Mid-West  were  the  subjects  for 
this  study.    The  students  were  enrolled  in  fourth,  fifth,  and 
sixth  grades.    There  were  twenty-one  girls  and  thirty  boys 
involved.    None  had  received  any  prior  training  in  problem 


solving.    The  students  were  randomly  assigned  to  either  a 
treatment  grouj  or  control  group. 

All  of  the  students  completed  the  Purdue  Elementary 
Problem  Solving  Inventory  (PEPSI),  developed  by  J.Feidhusen, 
as  a  pretest.    The  PEPSI  uses  a  filmstrip  and  audio  tape  with 
paper/pencil  response  sheets.    The  PEPSI  is  designed  to 
measure  several  skills  appropriate  to  problem  solving.  The 
subscales  on  the  PEPSI  include  such  things  as  sensing  that  a 
problem  exists,  judging  information,  analyzing  details,  solving 
problems,  and  verifying  solutions. 

A  computer  lab  setting  of  five  computu*s  was  used  for 
the  experimental  group  instruction.    The  experimental  group 
students  were  assigned  to  one  of  two  instructional  groups  that 
met  for  forty-five  minutes  each.    During  the  class  period,  the 
students  in  the  treatment  group  were  divided  into  computer 
work  triads,  small  groups  of  three  students  each.    The  students 
worked  on  one  lesson  each  week  for  eight  weeks,  starting  with 
Unit  1,  introducing  them  to  the  Solutions  UnlimiteH  iraterials. 
The  teacher  followed  the  directions  accompanying  the 
computer  software  to  insure  consistency  within  the 
experimental  groups.    The  control  group  participated  in  a 
creative  dramatics  class  during  th^  same  eight  weeks.  They 
were  given  an  opportunity  to  use  the  computer  software 
following  the  study. 

At  the  end  of  the  eight  weeks  all  of  the  students 
completed  th^  PEPSI  again  as  a  posttest.    The  difference  score 
for  each  student  was  calculated.    T-t'^sts  were/used  to 
determine  the  significance  of  the  difference  voetween  the 
pretest  and  posttest  scores.  / 

ResuKs 

The  results  of  the  study  did  not  indicate  any  significance 
^r.  the  diffeierce  scores  of  the  treatment  group.    The  students 
in  both  groups  generally  achieved  similar  change  scores. 
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Th^se  results  indicated  that  while  the  Solutions  Unlimited 
program  was  specifically  designed  to  teach  problem-solving 
skills,  the  students  participating  in  the  instruction  did  little 
better  in  the  posttest  than  did  the  students  who  had  not 
received  the  direct  instruction.    There  is  speculation  that  the 
design  of  the  PEPSI,  us^^d  for  measuring  the  change  in  scores, 
was  not  appropriate  for  the  age  group  involved.    The  answer 
sheets  should  have  been  changed  to  discourage  possible 
cheating  and  to  appear  less  primary. 

The  program  was  well  received  by  the  students 
participating  and  they  looked  forward  to  the  computer 
sessions.    It  may  well  be  that  problem  solving  cannot  be  taught 
for  forty-five  minutes  once  a  week,  but  needs  to  be  integrated 
into  the  entire  curriculum.    The  strength  of  the  computer 
program  used  is  in  its  simulations  that  create  realistic  life 
situations.    Students  need  to  recognize  that  the  skills  used  in 
that  single  situation  can  be  applied  in  other  similar  settings. 
The  suggestion,  then,  is  to  employ  techniques  for  transfer  of 
skills  learned  in  the  computer  simulations  to  new  and  novel 
situations!. 

The  literature  suggests  that  problem  solving  and  critical 
thinking  skills  cannot  be  developed  in  a  short  period  of  time, 
but  rather  may  take  several  years  to  develop.    We  may  be 
placing  too  high  an  expectation  level  on  the  students  when  we 
look  for  change  after  only  a  short  period  of  time  for  training. 
This  is  one  common  problem  with  many  of  the  research  studies 
done  in  computer  applications. 

Further  research  using  more  age  appropriate  forms  of  the 
test  and  using  the  supplementary  materials  to  teach  for 
transfer  is  necessary.    There  is  some  provision  for  follow-up 
activities  within  the  materials  used  in  this  study  to  stimulate 
the  possibility  of  transfer  of  newly  learned  problem-solving 
skills  to  other  situations.    Th   present  study  did  not  allow 
sufficient  time  to  complete  any  of  those  follow-up  activities.  A 
follow-up  study  is  being  designed  that  will  investigate  the 
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possible  change  in  scores  when  teaching  for  transfer  has  been 
added  to  the  instruction. 
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This  paper  describes  the  general  rationale,  hypotheses,  methodology,  findings  and 


implications  In  a  recent  dissertation  research  project  conducted  In  the  Columbus,  Ohio,  public  schools. 
The  computer-based  study  investigated  the  simultaneous  relationship  between  achievement  in 
microecorxxnics  arxl  attitude  toward  economics,  level  of  computer  anxiety,  and  attitude  toward 
teaming.  TwelKh-grade  students  In  regular  social  science  courses  (n^i55)  at  four  Columbus  senior 
high  schools  were  randomly  assigned  to  two  alternative  instnjctional  treatments.  Each  treatment, 
emphasizing  either  a  problem-oriented  strategy  or  a  rule-oriented  strategy,  consisted  of  a  week-long 
compirter-based  unit  teaching  funQanr)ental  economic  concepts  and  principles  of  supply,  demand,  and 
equilibrium.  Pre,  post  and  delayed-post  measures  were  given,  and  appropriate  data  analyses 
completed.  Results  of  these  analyses  Indteate  that  indivUuals  receiving  problem-oriented  Instructton 
perfomied  at  a  higher  level  on  all  of  the  cognitive  achievement  scales,  although  this  difference  was 
signifteam  only  for  questtons  on  the  lower-order  subscale  of  Posttest  I.  There  Is  also  evMence  that  a 
problem-oriented  strategy  may  positively  Influence  attitudes  towards  economics,  as  well  as  the  degree 
of  sophisticatton  towards  economic  Issues  generally. 
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INTRODUCTION 


During  the  last  fifteen  years,  the 


concept  learning,  knowledge 


microcomputer  has  emerged  as  a  dynamic, 
rapkJIy-evoMng  medium  of  instmctk>n 
(Hall,  1982,  1978).  Moreover,  rigorous 
research  Into  computer-based  Instmctton 
(Including  Interactive  videodisc, 
hypermedia,  and  compact-disc 
technologies)  has  had  a  slgniffeant  Impact 
on  the  entire  flekl  of  educatkxial  research, 
most  noCljeably  In  the  study  of  IndivkH'al 
differences  In  learning  and  the  Integrati^^n 
and  applteatkm  of  a  diversity  of  theories  H 


representatton,  and  instructtonp!  design 
(Kearsley,  Hunter,  &  SekJei,  1983). 
Evklence  suggests  that  advanced 
technologies  can  be  used  to  Improve:  (1) 
tlte  rate  of  lean^lng  (Kulik,  Bangeit,  & 
Williams,  1983);  (2)  the  degree  of  learning 
achievement  (Chambers  &  Bori;.  1983);  (3) 
the  attitudes  of  students  to^rds 
computers  (Magldson,  1978);  and  (4)  the 
nK)tivatk)n  and  Interest  In  the  learning 
experience  (Kearsley,  et  al.,  1963). 
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Also  during  this  period,  the 
development  of  curriciNum  and  instrirrtlon 
in  pre-coHege  economic  education  has 
t>ecome  increasingty  important  and 
widespread  throughout  the  public  schools 
of  the  United  States  (Walstad  &  Watts. 
1965).  in  estimathfig  the  effects  of  various 
programs  on  student  economic  learning, 
most  evaluation  studies  have  only 
measured  cognitive  outcomes  whia  often 
neglecting  to  measure  affective  leaming 
and  individual  differences  (Soper  & 
Wal5tad,  1963).  No  studies  have  attempted 
to  design  and  apply  research-based 
microcomputer  instnjctlon  In  economics 
while  analyzing  the  simultaneous 
relationship  between  achievenr)ent  in 
microeconomics  and  attitude  toward 
economics,  level  of  computer  anxiety,  and 
attitude  toward  leaming.  The  purpose  of 
this  study  was  to  be^  to  address  this 
problem,  and  to  acquire  a  broader 
understanding  of  the  complexity  involved  in 
the  development  of  economics  education 
courseware  and  concept  learning  in 
economics,  as  wen  as  gain  a  deeper  ir^ht 
into  the  phenomenon  of  leaming 
economics  from  computers  across  both 
cognitive  and  affective  domains. 

The  rationale  for  this  study  was 
based  on  the  emergence  of  two  important 
phenomenon  In  educatlonid  theory  and 
practic«>  (a)  the  systematic  design, 
development  and  widespread 
implementation  of  computer-based 
Ikistnjctional  courseware  In  public  school 
and  commercial  training  curricula,  and  (b) 
the  parallel  development  of  the  field  of 
economic  education  and  continuing 
research  into  the  relationship  between  the 
affdctlve  and  cognitive  fectors  related  to 
improving  economic  education  across  the 
academic  cunlculum.  In  particular,  critical 
gaps  in  the  literature  existed  in  the  design 
and  evaluation  of  precollege  computer- 
based  instructional  strategies  in 
microeconomics  and  the  investigation  of 
the  relationship  between  achievement  in 
microeconomics  concepts  and  attitude 
towards  economics,  economic  attitude 
sophistication,  level  of  computei  anxiety, 
and  attitude  towards  learning. 


Problem-Orlented  Instrugtlpn 

Cognitive  theories  that  broadly 
synthesize  Instructton  and  generatlvt^ 
learning  collectively  argue  that  changes  in 
behavior  occur  as  a  result  of  learning,  and 
that  learners  construct  meaning  as  they 
approach  new  content  domains  (Shuell, 
1986;  Wittrock.  1978.  1974).  Cognitive- 
designed  Instructional  systems  encourage 
the  ieamer  to  use  heuristics,  strategic  tools 
and  procedural  Icnowledge  during  the 
process  of  concept  acquisition  and 
problem-solving  (diSessa.  1977;  Nicl<erson 
et  al..  1985).  Computer-based  leaming 
envlronnoents  designed  from  a  cognitive, 
problem-oriented  model  may  fecilltate  the 
Individual's  ability  to  explore  his  or  her 
ihlnldng  processes,  deal  with  ambiguity, 
recognize  underiying  assumptions,  and 
search  for  commonalities  among  data 
(Peri<lns.  1986).  A  basic  rationale  for  the 
study  was  that  exploratory  research  Into 
both  the  structure  and  e^ecilveness  of 
emerging  technology-based  problem- 
oriented  strategies  to  teach  specific 
subjects  and  Icnowledge  domains  is 
essential  if  such  systems  are  to  prove 
useful  In  addressing  iong-temfi  Instructiana: 
needs. 

The  underiying  rationale  of  a 
"problem-oriented"  pedagogy  Is  that 
Instruction  can  foster  meaningful  learning 
by  emphasizing  relationship  and 
connectivity  between  Information,  concepts 
and  principles  within  a  relevant  context 
(l.e..  a  problem  scenario).  Stmcturing  the 
content  around  engaging,  Interactive 
problem  scenarios,  a  "problem-oriented" 
aoaptatton  of  Reigeluth's  Elaboration 
Theory  (Relgeluth.  1983)  approach  to 
Instoictlonal  design  emphasizes  the 
following  elements:  (1)  eariy  ideas  In  an 
Instructional  sequence  should  epitomize 
rather  than  summarize  concepts,  with  the 
superordlnate  principles  Introduced  first  as 
the  "glue"  thai  provides  the  conscious 
framewori<  for  ail  subordinate  concepts  that 
are  to  follow;  (2)  specific  cognitive 
strategies,  analogies  and  models  are  both 
explicitly  taught  and  embedded  within  the 
sequence,  and  provide  flexible  tools  with 
which  to  approach  problems  within  the 
domain;  (3)  concepts  and  principles  are 
then  synthesized  through  new  appilcattons 
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which  require  increasingiy  sophisticated 
analyses  and  applications  of  the  ieamed 
strategic  skVis  and  concepts;  and  (4) 
knowledge  within  a  sequence  is  only  then 
summarized  before  proceeding  to  a  deeper 
level  within  the  central,  superordmate 
principle  (an  elaboration  consisting  of  a 
more  advanced  epitome  and  complw 
problem).  These  specific  considerations 
underlie  the  rationale  of  the  experimental 
problem-oriented  treatment  In  this  study. 

RuleOrimitfid  Instmction 

Behavioral  theories  have  been 
extensively  applied  to  the  new  technologies 
of  instruction,   and   have.^^been  the 
foundation    upon    which    much  of 
conventional  computer  courseware  has 
been  designed.  These  theories  collectively 
argue  that  changes  in  behavior  are  learned, 
and  that  learners  associate  correct 
responses  to  stimuli  In  theb*  environment  as 
they  approach  new  content  domains 
(Sl<lnner.  ig54. 1958;  Amsel.  i960).  Whie 
the  view  of  thinking  as  an  operant  teamed 
response  predated  B.F.  SWnner.  the  major 
catalyst  in  applying  behavkxal  theory  to 
programmed    Instnictkxi    in  ^earning 
macNnes'  was  the  linear  frame-based 
approach  of  Skinner  (Lumsdalne.  i960). 
The  deductive,  step*by-8tep  sequencing  of 
Skinner's  Instmctkxial  strrtegy  emphasizes 
unambiguous,   impersonal,   rote  rule- 
example-recall  sequences,  followed  by 
immediate  reinforcement  after  a  correct 
respoi.se  (MerHI  &  Tennyson.  1977; 
Scandura.1964).  Computer-based  ieamlng 
environments  designed  from  a  behavkxal. 
rule-oriented   model    emphasize  the 
following  elements:  (1)  the  functkx)  of  the 
tasks  is  to  deliver  and  provUe  practtoe  in 
the  comprehenskxi  of  given  rules  and 
concepts  within  the  content  domain;  (2)  the 
tasks  foster  direct  concept  acqulsitkxi  by 
presenting  exploit,  well^efined  rules  with 
multiple  examples  to  liustrate  and  reinforce 
previously  stated  definitkxis  of  terms  and 
principles;  and  (3)  concepts  and  principles 
--re  organized  in  a  consistent,  predefined, 
linear,  hierarchtoal  sequence,  with  the 
broader,  most  comprehensive  principle 
ieamed  last,  and  only  after  all  previous 
material  has  been  delivered  and  ieamlng 
systematk^aliy  evaluated  ^.e*.  mastery). 


These  specific  conskJerations  underlie  the 
rattonale  of  the  experimental  rule-oriented 
treatment  In  this  study. 

Economic  Edunatli^n 

The  teaching  of  economte 
principles,  knowledge  and  reasoning  has 
becorfie  an  integral  part  of  the  core 
curriculum  In  American  schools  across  all 
grade  levels  K-12  (Qaric  &  Barron.  I98i; 
Walstad  &  Watts.  1985).  The  Jdnt  CouncM 
on  Economic  Educatton  has  supported  the 
development  of  computer  courseware,  film 
series,  and  other  media  to  provMe  students 
with  the  economic  understanding  and 
probiem-soMng  ability  needed  to  de^l  with 
both  personal  and  societal  economte 
issues  (Morton  et  al..  19B5;  Soper  & 
Walstad.  1983;  Walstad.  1979).  There  is  a 
growing  need  for  the  improvement  of 
economte   education   throughout  the 
curriculum,  and  therefore  research  that 
investigated  the  Inten^atlonshlp  between 
achievement  1 1  economics  and  attitudes 
towards  economtes  and  learning  woukl 
contribute  to  the  continuing  development  in 
mediated    instructional    strategies  In 
econontes  education,  and  may  have 
additkxial  implications  to  the  teaching  of 
thinking  and  problem-solving  across  many 
other   content   domains   (Heiman  & 
Slomianko.  1987;  Ntekerson,  et  al..  1985). 

it  was  hypothesized  that  tha 
problem-oriented  courseware  woukJ  result 
in   greater   cognitive  achievement  in 
mteroeconomics  on  the  overall  measures 
(i.e..  total  score  on  each  of  the  pre.  post, 
and  delayed  posltests).  and  on  the  higher- 
order  and  lower-order  question  subscales. 
Also,  it  was  believed  that  problem-oriented 
instructton  woukJ  result  *n  greater  long-term 
retentten  of  the  conceptual  knowledge, 
while  indivkJuals  expressing  a  deep 
approach  towards  teaming,  a  more  positive 
attitude  towards  economtes,  and  lower 
computer  anxiety  woukJ  perfomi  higher  on 
the  cognitive  measures  of  achievement. 
Finally,  previous  research  in  economte 
educatten  supported  the  hypothesized 
higher  cognitive  achievement  performance, 
and  more  "sophisticated'  and  positive 
attitudes  towards  economtes  for  male 
cul)|ecls  (Lumsden  &  Scott,  1987). 


Major  RttMrch  Imum 

The  study  examined  numerous 
questions  related  to  the  teaching  and 
acquisition  of  conceptual  knowledge  in 
microeconomics  via  proUem-oriented  and 
rule-oriented  computer-t)ased  Instructional 
strategies  Ofi  the  secondary  education 
level.  The  ten  alternative  research 
hypoihefas,  whie  providing  a  logical 
structure  to  the  Investigation,  were  not 
themselves  the  conceptual  focus  of  the 
study. 

The  principal  educational 
problems  addressed  in  the  study  included 
the  following  areas  of  inquiry: 


1)  The  effect  of  nie-oriented  and 
problem-oriented  strategies  on 
the  acquisition  and  retention  of 
basic  conceptual  Icnowledge  In 
microeconomics; 

2)  The  differential  effect  of  the  two 
Instructional  approaches  on 
learning  and  cognition  as 
measured  by  the  hlgher-ordor 
and  lower-order  question  levels 
of  the  achievement  instruments; 

3)  The  relationship  between  attitude 
toward  economics  and  economic 
attitude  sophirticat^on  In  a 
microeconomics  principles  lesson 
unit; 

4)  The  less  understood  factor  of 
computer-related  anxiety  In 
relation  to  precoilege  leamlng 
from  computer-tiased  instoiction; 

3)  Exploratory  knowledge  into  the 
deep  versus  surface  approach 
towards  leamlng  dk^hotomy, 
particularly  in  relation  to 
Instructkxi  In  a  sut)|6Ct  matter 
untamHlar  to  students; 

6)  The  factor  of  student  gender  as 
Inten^lated  to  the  other  research 
Issues  stated  In  this  sectk>n; 

7)  The  interBCtk>n  of  the  factors 
noted  above  In  reiatbn  to 


learning  in  a  computer- 
based  economics 
principles  unit; 


METHODS 

An  experimental  pretest/posttest 
study  design  was  conceived  to  empirically 
explore  a  complex  anray  cX  questk>ns  and 
issues  related  to  computer-based 
Instructton  In  mteroeconomlcs.  In 
analyzing  the  \  jtlvc  effteacy  of  two 
alternative  Instructional  strategies  (a  rule- 
oriented  and  a  problem-oriented  strategy). 
155  senk)r  high  school  students  from  four 
Columbus.  Ohio  secondary  schools 
parUcipated  during  the  final  data 
cdlecUon.  These  two  strategies  were 
broadly  derived  from  the  competing 
pedagogtoal  orientations  of  the  respective 
behavkxai  and  cognitive  schools  of 
psychology  and  learning  theory.  Two 
computer-based  lesson  units,  each 
designed  to  reflect  operaf  onal  verstons  of 
the  rule  or  problem  Instructtonai  strategy 
were  designed  to  teach  selected 
microeconomics  concepts  over  an 
intensive  five^y  perkxi  In  mterocomputer 
laboratories  located  at  each  of  the  four  site 
schools.  In  addKton  to  the  treatment 
variable,  gender  was  also  investigated  as  a 
factor  In  both  attitudes  and  learning. 

The  treatments  were  delivered  In 
similar  self-contained  computer 
laboratories  within  each  school,  on  i^pple 
lie  mterocomputers  equipped  with  either 
color  or  monochrome  monitors,  and  with 
one  student  assigned  per  computer 
woricstatton.  Each  arfe-oriented  and 
proUem-oriented  courseware  treatment 
sequence  included  five  full  dass  periods 
for  lesson  modules  (i.e..  Including  drill, 
tutorial,  and  simulation  components).  In 
additkm  to  five  dass  periods  used  for  pre 
and  post-instructkxi  data  collection 
procedures. 

A  battery  of  cognitive  and  affective 
Instalments  were  used  to  evaluate  the 
differential  effects  of  the  courseware 
treatments  on  both  student  achievement 
and  attitudes.  Including  Pretest  (r^.50). 
Posttest  I  (r==  ^5)  and  delayed  Posttest  11  ( 
r«  .62)repea;  J  measures.  Three  parallel- 
form  instruments,  composed  of  equal 
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numbers  of  higher  and  iower-order  level 
qijAfttinn^  were  constructed  from  items 
selected  and  modified  from  several 
naiionally-normed  tests  Including  the  Test 
of  Economic  Literacy  and  ttie  Test  of 
Understanding  in  College  Economics. 
Categortiation  of  all  achievement  questions 
Into  highei  and  lower  levels,  In  addition  to 
obtaining  content  validity  and 
representativeness,  was  corrotXHated  by  a 
Juror  of  qualified  individuals.  In  addition, 
the  Survey  on  Economic  Attitudes  and  the 
Computer  Anxiety  Index  described  earlier 
were  used  to  exannine  student  attitudes 
towards  economics  and  level  of  computer 
anxiety,  respectively.  The  third  attitude 
measure,  the  Leamlrig  Attitude  Sun/ey,  w^  n 
developed  to  Investigate  the  relationship 
between  general  approach  towards 
learning  and  other  fectors  in  the  study. 
Item  analysis  data  further  supported  the 
reliaMlty  of  these  instruments. 

Parallel  form  cognitive  achievement 
instruiiients  were  each  systematically 
developed  with  moderate  to  good 
reliability,  strong  cor^  validity,  and  two 
subscales  representing  higher-order  and 
lower-order  levels  of  cognitive  processing 
(Bloom  et  al.,  1956).  Three  existing 
affective  Indexes  were  obtained  tiiat 
measured  attitude  towards  economics 
(ATE)  as  a  sut)ject,  ttie  degree  of  econorr'o 
attitude  sophlsticatkxi  (^)  in  a  general 
understanding  of  the  market  system,  and 
attitude  -oward  computer  technology 
(CA1^J)  Indicating  relative  level  of  computer 
anxiety.  A  fourth  index  PEEP)  was 
developed  locally  to  measure  the  relative 
depth  of  a  student's  general  approach 
towards  new  learning  tastes  and  subject 
matters. 

The  effect  of  the  rule-oriented  and 
problem-oriented  computer-based 
instnjction^i  filrategies  on  teaching 
microeconomicsconceptowas  investigated 
using  a  variety  of  statistical  analytic 
techniques  including  the  paired  t-Test, 
univariate  and  fcictorial  analysis  of  variance, 
Chi  Square,  and  multiple  linear  regression. 
Cognitive  achievement  was  measured  with 
a  34-item  multiple-choice  pretest, 
immediate  posttest  (Fw^mest  I),  and  a 
delayed  posttest  delivered  after  a  two-weeic 
interval  for  retention  effects  (Posttest  11). 


The  four  affective  measures  (ATE,  EAS, 
CAIN  and  DEEP)  were  randomly 
administered  In  the  pretest  phase  while  all 
four  were  included  In  a  questionnaire 
battery  given  In  tiie  posttest  phase.  The 
data  on  these  affective  measures  werd 
scored  using  two  different  coding  schemes 
(a  straight  6-point  Ulcert  scale  and  a  16- 
point  certainty  estimate  scale),  attiiough 
only  data  derived  from  the  certainty  coding 
scheme  was  eventually  included  In  the 
definitive  analyses. 


Affective  issues 

Three  areas  of  interest  In  the 
affective  domain  were  investigated  In  this 
study:  (1)  student  attitude  toward 
economics;  (2)  degree  of  computer 
anxiety;  and  (3)  student  approach  or 
attitude  toward  leaming.  Each  of  these 
three  topics  applied  six-point  Ui(ert-type 
inventories,  and  are  discussed  briefly  In  the 
following  section. 


Attitude  Toward  Economic^ 

The  natlonallv-normed  Survev  on 
Economic  Attitudes  was  used  to  address 
this  need  (Soper  &  Walstad,  198^.  This 
Instrument  consists  of  two  subscales,  the 
ATE  (i.e..  Attitude  Toward  Economics; 
r = .88),  a  general  atiitudinal  measure 
toward  economics  as  a  sut^ject  area,  and 
the  EAS  (i.e..  Economic  Attitude 
Sophistication;  r».66),  comprised  of 
statements  reflecting  views  on  specific 
economic  issues,  and  measuring  the 
degree  of  sophistication  in  the  student's 
general  understanding  cf  the  mari<et 
system.  Together,  these  scales  provided  a 
reasonably  comprehensive  measure  of 
student  attitude  toward  economics. 


Comouter  Anxiety 

The  nationally-normed  ^^puter 
Anxiety  Index  (Maurer,  1983;  .^.94),  a 
measure  of  generalized  anxiety  towards  the 
computer,  was  applied  to  investigate 
collateral  problems  associated  with 
instructional  computer  usage.  Generally, 


student  populations  tend  to  be 
positlve/nomnaliy  distributed,  indicating  a 
general  acceptance  and  absence  of  any 
specific  fear  of  computer  technology  by  the 
majority  of  population.  A  small  but 
significant  group  of  individuals  tend  to 
exhibit  considerably  higher  computer 
anxiety  than  the  norm,  however,  and  so  It 
is  valuable  to  Include  this  factor  in 
computer-based  educational  research 
projects. 

Attituda  Toward  Laamina 

In  addition,  a  special  questionnaire,  the 
Leamino  Attituda  Stin/ayT^  as)  was 
developed  k)caliy  to  nieasure  students' 
general  approach  to^yards  leaming.  A 
surfece  approach  was  characterized  by 
Instmmentalism,  entrinsic  motivation, 
performing  leaming  tasks  as  means  to 
other  ends,  memorization  of  new  material, 
and  student  concem  over  the  length  of 
time  the  learrLig  task  would  take.  A  deep 
approach  towards  learning  was 
characterized  by  interest  in  the  material 
itself,  intrinsic  motivatk>n,  relating  new 
infomiatkm  to  prevkxjs  knowledge, 
inductive  and  exptoratoiy  reasonbig  during 
a  leaming  task,  and  a  personalizatton  of  the 
new  knowledge  (Biggs  &  Rihn,  19S4).  The 
'deep  approach  towards  leaminflrsubscale 
proved  to  be  higNy  reliable  (DEEP  t^.B2\ 
and  was  used  in  a  broader  a.  ialysis  J- 
attftudenreiated  factors. 


Experimental  Treatment 

Ruie-Oriented  l^^on  S^tf 

In  the  rule-oriented  lesson  set, 
the  general  in8tnjctk)nal  sequence  used  a 
combined  drill  and  tutorial-based  approach, 
proceeding  through  the  presentatk>n  of 
concepts  and  questkm  delivered  wKhin 
the  context  of  explkA  expository  and 
inquisitory  InstnjctkMi  (Allen,  1966;  Menlil, 
1983;  Merrill  &  Tennyson,  t977).  The 
strategy  conslsteJ  of  (a)  a  series  of 
infonTiatk>n  presentatkxis,  (b)  mle-recali 
questions,  and  (c)  oile-example/non- 
example-instance  Instnjctkxial  sequences 
teaching  knowledge  of  the  major  principles 
and  concepts  in  mtoroeconomte  theory. 


Brief  review  and  overview  sections  began 
each  lesson  module  to  maintain  the 
continuity  between  lessons.  Supply  and 
demand  were  introduced  as  the 
fundamental  components  of  the  market 
system,  while  equilibrium  was  presented  as 
the  superordinate  concept  between  supply 
and  demand.  Subsequent  expository  and 
inquisitory  sequences  required  appltoatton 
of  the  prevk>u«  cont6<it  nnd  an  increasingly 
complex  set  of  well<:eflned  economto  mles 
that  were  both  explteitly  taught  and 
exemplified  throughout  the  lessons. 

A  rule  as  viewed  here  is  a 
knowledge  representation  of  some  event  or 
object  (e.g.,  economic  supply)  consisting 
of  a  name  and  con^esponding  definttion 
classifying  the  behavior  or  structure  of  the 
event  or  object  (Menlil  &  Tennyson,  1977). 
Hence  the  temi  »ijie-oriented  refers  to  the 
technkjue  of  (a)  employing  superordinate 
and  subordinate  concept  names  and 
definittons  presented  initially  with  critical 
and  variable  attributes  (expository 
generalities),  (i .)  presenting  and 
contrasting  examples  and  non-examples 
(expository  instances),  (c)  frequent 
questk>ning  on  the  rules  and  concepts 
names  and  definitions  (inquisitory 
generalities,  including  direct  recall 
questtons);  and  (d)  questioning  newly 
encountered  examples  (inquisitory 
instances)  to  augment  student 
understanding  concepts  within  a  logical 
and  unambiguous  rule  hierarchy.  Leaming 
the  oile  definitk>ns  thus  promotse  a  deeper 
understanding  of  the  change  relationships 
of  supply,  demand,  and  ^uilibriUTi. 

The  rule-oriented  lesson  set 
consisted  of  the  five  program  diskettes. 
Fdlowing  the  introduction,  the  initial 
concept  sequence  bega^i.  The  general 
instructional  sequence  followed  a 
consistent  series:  (a)  first,  an  advanced 
organizing  preview  and  review  segment 
prepared  the  leamer  for  the  current  lesson, 
(b)  the  subsequent  presentatk>n  of  a  rule 
name  and  definition  (expository  generality; 
the  initial  presentation  of  the  definition 
included  the  critical  and  variable  attributes 
of  the  concept),  (c)  a  recall  question  on  the 
preceding  mle  name  and  definition 
(inquisitory  generality),  (d)  a  set  of  paired 
examples  and  non-examples  in  tabular 
form  and  brief  descriptions  of  an  economic 
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situation  which  served  to  illustrate  and 
discriminate  the  rule  clearly  (expository 
instance),  (e)  a  question  on  the  preceding 
material  using  an  example  not  encountered 
previously,  and  (f)  a  summarizing 
restatement  of  the  newly  acquired  concept 
name  and  Ueflnltlon.  This  basic  sequence 
was  reiterated  throughout  each  lesson  disk. 
All  questions  included  infomiing  the  learner 
of  results  and  supplying  the  con^  answ^^r 
if  the  learner  was  unsuccessful  after  the 
second  attempt.  A  summatlve  review, 
Including  the  presentation  of  rule  tables 
listing  each  previously  learned  concept  and 
followed  by  a  mastery  series  of  8-10 
questions  concluded  each  lesson. 


Problem-Oriented  Lesson  Set 

In  the  problem-oriented  lesson 
set.  the  general  instructional  sequence 
employed  a  roie-playing  simulation  of  an 
imaginary  business,  proceeding  through 
the  presentition  of  coricepts  and  questions 
embedd^  within  the  context  of  problem 
scenarios  and  events.   The  lesson  set 
consisted  of  a  series  of  situations 
emphasizing  application  and  anal^  level 
knowledge  of  the  major  principles  and 
change  relatkniships  In  mteroeconomk: 
theory.  Brief  review  and  oven/lew  sectk>ns 
began  each  lesson  module  to  maintain  the 
continuity  between  lessons.  EquHlbrium. 
the  superordlnate  concept,  was  presented 
initially  and  consistently  as  a  unifying 
construct  between  supply  and  demand. 
Subsequent  problem  situatkKis  required 
application  of  the  studenfs  growing 
knowledge  and  a  specifk:  cognitive 
strategy:  the  "Graphte  Method."  This 
cognitive  strategy  was  both  explteiUy 'aught 
and  repeatedly  embsdded  throughout  the 
lessons  to  gukJe  students  In  hypothesis 
generation    and    testing  concerning 
changing  behavtor  within  the  simulated 
mari<el  system.  Hence  the  temi  problem- 
oriented  refers  to  the  technique  of 
emptoying  problem  situations  as  the  core 
to  understanding  concepts  operattonally. 
and  in  using  a  context-specific  probiem- 
soMng  strategy,  the  Qraphte  Method,  to 
resolve  the  problem  by  predk:ting  the 
outcome  based  upon  mari(et  changes  in 
supply  and  demand. 


The  Problem  Scenario.  The  student  Is 
placed  in  the  role  of  the  owner  and  chief 
executive  officer  of  a  new  business.  At  the 
same  time  the  computer  tutor  component 
of  the  program  plays  the  role  of  a 
professtonal  consulting  firm  (Microbiz 
Associates)  for  young  companies  simPar  to 
the  orie  the  student  is  now  operating.  The 
Mea  is  broadly  to  establish  a  friendly 
working  relationship  between  the 
'consulting  firm'  tutor  and  the  student 
'manager*  in  the  course  of  operating  the 
new  business  successfully. 

The  student  is  requested  to  invent 
both  a  product  and  a  company  name.  The 
student  enters  these  names  into  the 
program  and  they  are  subsequently 
presented  within  each  problem  situatk)n, 
feedback  elaboration  and  remedlatton 
segments  of  that  particular  courseware 
program  Various  nxytivational  frames 
appear  throughout  the  lesson  to  encourage 
the  student  manager  to  become  Interested 
in  the  proHt-nriaking  capabilities  of  his  or 
her  own  business  enterprise.  The  mplteii 
suggestion  Is  made  that  profit  wll  be 
enhanced  by  correct  decision-making 
during  the  business  operatton  cyde.  (each 
lesson  represents  a  corporate  3-month 
quarter). 

The  new  company  begins  In  full 
productton  of  the  chosen  good  or  servtoe. 
The  new  student  manager  is  periodk:ally 
presented  with  simulated  electron^  mall 
business  reports  sent  from  the  Microbiz 
firm.  The  content  o^  each  report  is  a 
simulated  problem  situation,  each 
describing  a  set  of  partteular  events 
requiring  the  immediate  attention  of  the 
business  manager.  These  on-line  reports 
include  text,  supply  and  demand 
schedules,  and  graphs  of  supply  and 
demarvd  curves.  The  manager  is  then 
required  to  predict  the  effect  of  the 
economic  changes  in  the  determinants  of 
supply  and  demand  on  the  new  equilibrium 
price  and  quantity  of  his  or  her  product.  At 
the  concluston  of  each  program,  a 
synthesizing  review  is  preslhted  over  the 
concepts  emphasized  during  the  recent 
'business  quarter".  At  the  conclusion  of 
the  lesson  set.  a  summatlve  evaluation  of 
student  peribmriance  in  terms  of  'profit 
points'  is  presented. 


RESULTS 

In  summary,  several  trends  can 
be  Identified  from  the  results.  First,  the 
main  effect  of  treatment  was  statlstically 
significant  in  only  one  case  that  Indicated 
the  marginal  superiority  of  the  pn3blem- 
oriented  sut)|ectd  on  the  lower-order 
subscaleofPosttestl.  Gender  nnaln  effects 
on  the  cognitive  perfomnance  measures 
were  not  found,  although  several  gender- 
related  trends  were  obsen^ed  including  the 
consistently  superior  performance  of  males 
on  ail  cognitive  variables  and  a  significantly 
higher  ATE  reported  among  the  malt 
subjects. 

Concerning  the  measurement  of 
economic  attitudes,  ATE  was  positively 
related  to  cognitive  perfonnance.  with 
superior  achievement  related  to  higher 
ATE.  The  results  generally  confimi  the 
findings  of  Soper  &  Walstad  (1987.  1988) 
that  a  nxxierately  positive  association 
exists  between  the  constructs  of  attitude 
toward  economics  and  economic  attitude 
sophistication.  Moreover,  the  combination 
of  ATE  and  EAS  appear  strongly  related  to 
superior  cognitive  perfonnance  only  when 
both  are  "High".  Higher  perfbrmers  have 
High  ATE/HIgh  EAS  combinations  In  most 
cases,  whie  lower  performers  tend  to 
report  Low  ATE/HIgh  EAS  or  High 

ate/Low  eas. 

Conceming  the  interaction  of  CAIN  and 
DEEP,  another  trend  appears  for  higher 
perfbnners  report  Low  DEEP/Low  Anxiety, 
while  lower  perfonners  report  High  DEEP 
and  High  Anxiety  and  CAIN  score  Is 
Inversely  related  to  cognitive  achievement: 
the  lower  the  computer  anxiety  reported, 
the  higher/better  the  cognitive  performance 
(on  most  measures).. 


achievement  was 
statistically  significant  (q  = 
.045)  as  a  main  effect  only 
In  the  lower-order 
subscale  of  Posttest  I, 
however. 


2)  Mean  scores  of  Male  sut^ects 
were  greater  than  female  subjects 
on  all  cognitive  measures, 
Including  the  overall  score  and 
both  higher  and  lower-order 
subsc&ie  score  on  Posttest  i  and 
II.  importantly,  none  of  these 
differences  was  significant. 


3)  None  of  the  ATE  or  EAS  main 
effect  differences  was  statistically 
significant  for  any  cognitive 
measure  Including  the  overall 
score  and  both  higher  and  lower- 
order  subscale  score  on  Posttest  I 
and  II. 


4)  A  significant  dlsordlnal  Interaction 
was  obsen/ed  between  ATE  and 
EAS  on  the  overall  Posttest  I  score 
(B  »  .017).  Subjects  In  the  High 
ATE/HIgh  EAS  group  outscored 
all  other  sut)|ects.  and  this  mean 
difference  was  greatest  between 
High  ATE/HIgh  EAS  and:  (a)  the 
High  ate/Low  EAS  group  (3.00 
points)  and  (b)  the  Low  ATE/HIgh 
EAS  group  (2.34  points).  Both 
differences  are  considered 
Important  from  a  practical 
perspective. 


Result  Summary 

1)  Subjects  In  the  problem-oriented 
treatment  group  consistently 
outscored  their  rule-oriented 
counterparts  on  most  cognitive 
outconoe  measures  Including  the 
overall  score  and  lower-order 
subscale  score  of  Posttest  I  and 
II.  and  the  higher-order  score  of 
Posttest  I.  This  superior  cognitive 


5)  A  dlsordlnal  Interaction  between 
ATE  and  EAS  on  the  higher-order 
subscale  of  Posttest  I  was 
obsen/ed  In  which  subjects  In  the 
High  ATE/HIgh  EAS  'group 
outscored  all  other  groups  (g  » 
.022).  A  slmOar  dlsordlnal 
Interaction  between  ATE  and  EAS 
was  also  obsen/ed  In  relation  to 
mean  performance  on  the  lower- 
order  subscale  of  Posttest  I  (g  » 
.045).  Again,  subjects  In  the  High 
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ATE/Hc^  EAS  gap  GUsocred  al  dher 
groups.  Greatest  dWerence  in  mean 
performance  was  between  the  High 
ATEAHigh  EAS  group  end  the  High 
Al^/lxMf  EAS  gap  (12D  pokts).  sMar 
to  the  mis  far  tB  PosttBSt  I  OMaal  and 
higher-order  scores. 


A  disordinal  interaction  t>etween 
ATE  and  EAS  was  shown  In 
relation  to  mean  performance  on 
the  lower-order  subscale  of 
Posttest  Wia^  .025).  The  result 
In  this  case  was  consistent  with 
the  other  significant  interactions 
noted  above  In  summary 
paragraphs  4  and  5:  subjects  In 
the  High  ATE/HIgh  EAS  group 
outscored  all  subjects  on  the 
lower-order  subscale  of  Posttest 
II,  with  the  greatest  difference  In 
mean  performance  obsen/ed 
between  the  High  ATE/HIgh  EAS 
group  and  the  Low  ATE/HIgh 
EAS  group  (1.70  points). 


No  statistically  significant 
differences  could  be 
denfK)nstrated  for  the  overall 
score  main  effects  of  the 
computer  anxiety  variable  (CAIN), 
although  evidence  was  presented 
Indicating  a  trend  toward  superior 
perfonnance  by  subjects  in  the 
lower  anxiety  group  on  the 
overall  perfonfnance  means  of 
both  Posttest  I  and  II.  In  the 
case  of  Posttest  I,  the  difference 
was  1.32  points;  for  Posttest  II 
the  corresponding  difference  was 
1.18  points. 


S*  ~  ilflcant  main  effects 
d«:»erences  were  reported  for  the 
computer  anxiety  variable  (CAIN) 
on  the  higher-order  subscale  of 
Posttest  I  and  the  lower-order 
subscale  of  Posttest  II. 
respectively.  The  trend  for 
superior  performance  (1.10 
points)  by  subjects  In  the  Low 
Anxiety  group  was  observed  on 


the  higher-order  subscale 
performance  means  of 
Posttest  I  (b  ^  .027).  For 
Posttest  II,  the  difference 
between  High  and  Low 
anxiety  subjects  was 
significant  only  for  the 
lower-order  subscale 
means  (q  =  .063). 


9)  No  statistically  significant 
differences  could  be  demonstrated 
for  the  overall  score  main  effects 
of  the  deep  approach  towards 
learning  variable  (DEEP). 
However,  a  surprising  trend  of 
superior  test  performance  by 
subjects  In  the  Low  DEEP  group 
over  subjects  In  the  High  DEEP 
approach  group  was  observed  in 
the  overall  performance  means  of 
both  Posttest  I  and  II  (1.25  and 
0.34  points,  respectively). 


10)  A  significant  main  effect  for  the 
deep  approiuH  toward  leamlng 
variable  was  reported  only  In  the 
case  of  the  lower-order  subscale 
of  Posttest  i.  Similar  to  the  trend 
observed  In  summary  p^trdgraph 
9.  subjects  In  the  Low  DEEP 
group  scored  higher  than  their 
counterparts  In  the  High  DEEP 
group  by  0.95  points  (q  »  .054). 


11)  The  ordinal  Interaction  of 
treatment  and  EAS  on  the  lower- 
order  subsca'e  of  Posttest  1 
indicated  the  superior  performance 
of  subjects  In  the  problem-oriented 
group  in  both  Low  and  High  EAS 
conditions.  The  treatment  variable 
(TREAT)  here  indicated  a  main 
effect  result  (q  =  .050).  The 
largest  difference  was  observed 
between  prot>lem-oriented  and 
rulo-orlented  subjects  on  the  High 
EAS  level  (1.70  points),  indicating 
a  potentially  beneficial  relationship 
between  learners  with  High  EAS 
and  problem-oriented  instruction  In 
economics. 


Results  for  the  disoitJInal 
tnteraction  of  traotment  and  EA8 
on  the  lower-order  subscale  of 
Poettest  II  are  the  reverse  of  the 
previous  finding  for  Posttest  I 
(See  summary  paragraph  li 
atxive  and  also  Figures  6  and  7). 
Whie  the  treatment  varlatile  was 
not  Itself  significant  (treatment 
was  significant  in  the  Posttest  I 
case),  the  disordinal  interaction 
between  treatment  and  EAS  was 
much  more  pronounced  (g  » 
.006).  The  greatest  difference 
between  means  (1 .80  points)  was 
between  problem-oriented  (7.00 
points)  and  mie-oriented  (5.50 
points)  groups  In  the  Ljow  EAS 
category.  This  situation  was 
reversed  in  the  High  EAS 
category  with  sut)|ects  In  the  rule- 
oriented  group  outscoring 
subjects  in  the  problemoriented 
group  by  0.80  points. 


Adisordlnal  Interaction  was  found 
between  level  of  treatment  and 
CAIN  score  for  the  lower-order 
subscale  of  Posttest  II  (q  «  .023). 
While  subscale  mean 
perfbnnance  remained  relatively 
consistent  across  problem- 
oriented  sut)|ects  In  either  High 
and  Ljow  computer  anxiety 
categories,  rule-oriented 
treatment  group  performance 
changed  noticeably  across  the 
Low  to  High  Anxiety  dichotomy. 
Although  IxNi  Anxiety  sut)|ects  In 
the  njle-oriented  treatment 
outscored  all  groups,  their  Higher 
Anxietyrule-orlentedcounterparts 
scored  considerably  lower  (i.go 
points  lower  mean  score), 
showing  the  largest  difference 
between  any  two  groups. 
Problem-oriented  subjects  in  the 
High  Anxiety  group  achieved 
superior  perfonnance  over  the 
High  Anxiety  rule-orlentod 
sut)jects  by  1.40  points.  The 
importance  of  the  computer 
anxiety  variable  is  demonstrated 
by  the  main  effect  result  (g  ^ 


.084). 


14)  A  disordinal  interaction  of  ATE  and 
DEEP  on  the  higher-order 
subscale  of  Posttest  II  was 
reported  (g  -  .080).  WhUe  High 
DEEP  subjects  outscored  all 
groups,  the  High  DEEP/HIgh  ATE 
sut)jects  scored  lower  than  Low 
ATE/HIgh  DEEP  (0.70  points)  and 
High  ate/Low  Deep  (0.50  points). 
The  largest  difference  between 
groups  (1.00  point)  occun'ed 
between  the  High  DEEP  and  Low 
DEEP  subjects  in  the  Low  ATE 
category. 


15)  A  significant  three-way  interaction 
was  observed  t>6tween  treatment, 
ATE  and  EAS  on  the  higher-order 
subscale  of  Posttest  11  ^  »  .058). 
Highest  scorers  were  in  the 
prot)lem-oriented  treatment  In  the 
High  ate/Low  EAS  category, 
while  lowest  scorers  were  In  the 
problem-oriented  treatment  In  the 
Low  ate/Low  EAS  category 
(Means  »  6.00  and  4.37, 
respectively).  This  particular  mean 
difference  (1.63  points)  suggests 
that  High  ATE  Is  more  important 
than  EAS  as  a  factor  In  cognitive 
performance.  However,  although 
High  ATE  Is  Influential,  especially 
In  combination  with  Low  EAS, 
where  EAS  Is  high  for  both 
groups,  ATE  was  not  as  salient  on 
the  higher-order  questions  of 
Posttest  II. 

16)  Highest  scorers  on  the  overall 
P'^sttest  I  mean  were  male 
subjects  in  the  High  ATE/HIgh 
EAS  category  (Mean  =  16.95) 
while  lowest  scorers  were  female 
sut>|ects  in  the  High  ATE/Low  EAS 
group  (Mean  =  12.95).  Although 
this  4-polnt  difference  was  very 
signtricant  from  a  practical  view, 
the  gender  x  ATE  x  EAS 
interaction  was  not  statistically 
significant  on  the  overall  Posttest  I. 
The  ATE  x  EAS  interaction  was 
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Kaeir  signlksut,  however  to 
Males  and  females  performed  at  the 
same  iGMBi  \Mhen  bdh  were  ki  the  High 
ate/Low  EAS  category.  Also,  the 
relatioiiship  betvveen  higher  ATE  and 
High  EAS  attitudes  In  economics 
cognitive  achievement  vvas  more 
pronounced  In  the  male  subjects. 


A  significant  interaction  was 
observed  between  gender,  ATE 
and  EAS  on  the  lower-order 
subscale  of  Posttest  I  (q  «  .082). 
Highest  scorers  (IMean  -  9.06) 
were  males  reporting  Low 
ATE/I^  EAS,  whie  lowest 
scorers  (Mean  >  6.91)  were 
males  reporting  High  ATE/I^ 
EAS.  This  Is  the  converse  of  the 
expected  relationship  and 
performance  outcomes. 


The  three-way  interaction  of 
gender  X  ATE  x  EAS  approached 
significance  on  the  overall 
Posttest  II  score  (g  »  -124). 
Highest  scorers  were  females  In 
the  High  ATE/HIgh  EAS  group 
(Mean  -  12.56),  whUe  lowest 
scorers  were  females  in  the 
ATE/HIgh  EAS  group  (Mean  = 
9.62),  a  2.91  point  difference. 
This  result  supports  the  role  of 
High  ATE  in  superior  retention 
performance. 


Although  not  statistically 
significant,  the  inteneictlon  of 
gender,  ATE  and  EAS  on  the 
lower-order  subscale  of  Posttest 
II  also  corroborated  the 
importance  of  ATE  in  relation  to 
cognitive  performance  outconr)es 
(D  -  .163).  The  widest  difference 
was  between  female  subjects  In 
the  High  ATE/KIgh  EAS  group 
and  females  in  the  1^  ATE/HIgh 
EAS  group  (Means  «=  7.31  and 
4.69,  respectively. 

A  significant  interaction  was 
reported   between  treatment. 


computer  anxiety  and 
DEEP  on  the  overall 
Posttest  II  score  (j2  » 
.076).  Highest  scorers 
were  subjects  in  the  rule- 
oriented    treatment  group 

with  Low  deep/Low 

Anxiety  (Mean  -  14.00), 
while  lowest  scorers  were 
rule-or!ented  treatment 
subjects  with  Low 
DEEP/High  Anxiety  (Mean 
"  10.15).  a  mean 
difference  of  3.85  points. 
Treatment  groups  were 
closest  when  rule-oriented 
treatment  subjects  were 
Low  deep/Low  Anxiety 
and  when  problem- 
oriented  treatment 
subjects  were  Low 
deep/Low  Anxiety 
(Means  »  11.14  and 
1 1 .25,  respectively).  This 
finding  supports  the 
importance  of  the  CAIN 
measure,  and  the 
consistent  superior 
cognitive  performance  In 
Ihh  computer-based  study 
of  subjects  with  lower 
computer  anxiety. 

21)  A  significant  interaction  was  also 
reported  between  treatment, 
computer  anxiety  and  DEEP  on 
the  lower-order  subscale  of 
Posttest  II  (b  =  .076).  Highest 
scorers  were  subjects  in  the  rule- 
oriented  treatment  with  Low 
deep/Low  Anxiety  (Mean  «  8.27). 
whHe  lowest  scorers  were  rule- 
oriented  treatment  subjects  with 
Low  DEEP/High  anxiety  (Mean  » 
5.15).  a  mean  difference  of  3.12 
points.  In  ail  mean  comparisons 
within  the  High  Anxiety  group,  the 
problem-oriented  treatment  group 
outscored  the  rule-oriented 
treatment  subjects,  and  this 
superiority  was  clearest  when  both 
treatment  groups  were  in  the  Low 
DEEP  category  (Means  «  7.04 
and  5.15,  respectively).  The 
finding    again    supports  the 
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iTfxitro  gT  tB  CMN  nrnaie  and  fB 
oonsiQCsnlly  superior  perfonT!ano9  of 
8ii3|edB  wlh  io^  oimpilBr  arwiety. 
TheoomputerarDdetyfBciDr,  hoMMsr, 
appears  to  hove  been  less  salient  for 
sut)iects  in  the  problem-oriented 
treatment. 


A  significant  three^y  interaction 
was  observed  between  gerider, 
computer  anxiety  and  DEEP  on 
the  Posttest  I  Ngher-order 
subscale  (q  -  .052).  Highest 
scorers  in  this  case  were  males 
in  the  High  OEEPAow  Anxiety 
group,  whie  lowest  scorers  were 
males  in  the  High  DEEP/High 
Anxiety  group  (Means  -  8.20  and 
5.27,  respectively).  The 
difference  here  of  2.93  points 
conroborates  other  findings  of  the 
value  of  the  CAIN  measure.  A 
second  important  difference  was 
seen  between  females  in  the  Ixiw 
DEEP  category  reporting  High 
Anxiety  (Mean  -  5.54)  and  those 
reporting  Low  Anxiety  Mean  » 
7.28),  a  1.74  mean  difference. 


A  significant  three-way  interaction 
was  obsen/ed  between  gender, 
computer  anxiety  and  ATE  on  the 
Posttest  I  lower-order  subscale 
(D  »  .044).  Highest  scorers  in 
this  case  were  males  in  the  High 
ate/Low  Anxiety  group,  whHe 
lowest  scorers  were  males  in  the 
High  ATE/High  Anxiety  group 
^eans  -  9.13  and  7.14, 
rivspectively).  This  result  again 
demonstrates  the  salience  of  the 
CAIN  measures  in  studies 
involving  computer-based 
instmctlon  in  economics. 


A  series  of  hierarchical  multiple 
regression  analyses  were 
perfdnned.  Apart  from  the 
inclusion  of  the  treatment  variable 
(D  »  .045).  the  DEEP  score  (g  » 
.046)  and  to  some  degree  the 
CAIN  score  (g  «  .089)  on  the 


lower-order  subscale  of 
Posttest  1.  no  other 
statistically  sigr  *<cant 
regression  flnoings 
involving  the  primary 
independent  variables 
were  observed.  The 
application  of  Pretest  and 
Posttest  I  variables  as 
regressors  was  successful 
on  all  scales  (g  »  .000  In 
each  case),  confirming 
that  (a)  the  use  of  pretest 
scores  in  the  case  of  an 
immediate  posttest  (OV), 
and  (b)  both  pretest  and 
immediate  posttest  scores 
in  the  case  of  a  delayed 
posttest  (DV)  are  reliable 
in  explaining  the  variance 
of  th<>ir  respective 
dependent  variables. 


CONCLUSION 

Findings  indicate  there  may  be 
pucential  benefits  of  employing  problem- 
oriented    strategies    in  computer 
courseware  teaching  basto  concepts  In 
microeconomics.     While  a  problem- 
oriented  strategy  may  not  result  In 
significantly  superior  level  of  concept 
acquisition  compared  to  a  conventional 
rule^riented  strategy,  there  Is  evidence 
that  problem*oriented  courseware  may 
positively    Influence    stixlent  attitude 
towards  economics,  as  well  as  students' 
degree  of  sophistication  towards  economic 
Issues  about  the  mari<et  system  In  general. 
As  technology-t>ased  problem-oriented 
environments    become  Increasingly 
powerful  and  dynamic,  increased  benefits 
In  cognitive  achievement,  and  In  particular 
In  positive  affective  changes,  may  be 
observed  In  the  long  tenii.  However,  high- 
quality  njle-oriented  strategies,  however, 
are  apparently  both  adequate  and  equally 
effective  for  certain  learners  (la.,  with  a 
surfece  approach  toward  learning)  and 
certain  learning  tasics  with  well-defined 
content  domains.     The  single  most 
"effective"  strategy  may  require  some 
optimal  hybrid  combination  of  problem 
and  ode  approaches,  or  other  instructional 
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theories  and  techniques.  Future  research 
investigating  the  application  of  instnxAlonal 
technologies  to  secondary  content  areas 
should  de-emphasize  the  gross  comparison 
o*  strategies  and  short-term  outcomes  and 
systematically  disaggregate  specific 
individual  difference  factors  in  the  study  of 
long-tenn  curricular  implementation  of 
various  instnjctional  strategies. 
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ABSTRACT 


This  paper  reports  researw  h  in  progress.  The  purpose  of  this  study  was 
to  examine  the  growing  variety  of  research  emerging  in  Distance  Education  and 
to  suggest  a  method  for  synthesizing  the  results.  Over  60  articles,  representing 
both  quantitative  and  qualitative  studios  published  in  major  journals  during  the 
past  two  years,  were  abstracted  and  reviewed.  Preliminary  research  categories 
have  been  determined  and  a  meta-analytic  model  has  been  designed  to 
synthesize  the  experimental  and  quasi-experimental  data.  The  remaining 
qualitative  studies  will  be  subjected  to  a  heuri.stic  analysis  to  present  a  fuller 
picture  of  methods  and  results  of  research  currently  being  done  in  distance 
education. 

BACKGROUND 

The  thaory  and  practice  of  learning  at  a  distance  is  not  new.  It  is  a 
concept  which  includes  all  forms  of  teaching  in  which  the  teacher  and  learner 
are  separated  by  time  and  space.  Correspondence  study,  home  study  and 
independent  study  were  all  early  forms  of  what  is  referred  to  today  as  distance 
education.  However,  the  past  twenty  years  have  shown  unprecedented  growth 
in  the  number  of  institutions  providing  distance  education  throughout  the  world. 
In  1971  the  United  Kingdom  Open  University,  also  known  as  the  British  Open 
University,  began  operation.  It  was  quickly  followed  within  the  next  ten  yoars  by 
Canada's  Athabasca  University,  China's  Television  University,  Germany's 
Fernuniversitat ,  Israel's  Everyman's  University,  Pakistan's  Allama  Iqbal  Open 
University,  and  Venezuela's  Universidad  Nacional  Abierta  (Rumble  &  Harry, 
1982).  The  1980s  have  seen  the  establishment  of  similar  open  university 
programs  in  Thailand;  Turt^ey,  Nigeria  and  many  developing  countries  of  the 
world  (Mclsaac,  Murphy  &  Demiray,  1988).  Recently,  more  than  700  delegates 
participated  in  the  14th  World  Conference  of  the  International  Council  for 
Distance  Education,  held  in  Oslo  in  August  1988.  During  that  conference,  major 
presentations  and'research  reports  from  over  50  countries  were  added  to  the 
growing  body  of  research  in  distance  education  (ICDE,  1988).  The  increasinq 
number  of  research  articles  arriving  at  the  United  Nations  University 
International  Documentation  Centre  (Hany,  1988),  the  recent  First  American 
Symposium  on  Research  in  Distance  Education  and  the  creation  in  1987  of  the 
American  Journal  of  Distance  Education  (Moore,  1987,1988)  all  reflect  the 
proliferation  of  documentation  and  research  in  this  area. 

Although  research  is  reported  in  three  or  four  major  journals  devoted  to 
the  literature  in  distance  educaticn,  there  has  been  no  effort  to  centralize 
research  findings.  Due  to  the  nature  of  the  endeavor,  descriptions  of  programs, 
surveys,  and  experimental  studies  may  be  reported  at  conferences,  in 
government  reports,  in  journals,  and  in  newsletters.  Such  information  is  difficult 
to  locate  and  interpret.  This  paper  reports  research  in  progress  relating  to  one 
project  undertaken  to  determine  emerging  research  themes  and  to  examine  the 
body  of  accumulated  research  concerned  with  distance  education. 

A  meta-analytic  model  was  designed  and  a  sample  of  62  research 
studies  In  distance  education  was  selected  for  preliminary  evaluation.  Meta- 
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analysis  is  a  technique  which  quantitatively  synthesizes  experimental  and 
quasi-experimental  research  by  transforming  data  to  standard  scores  and 
reporting  effect  sizes  (Glass,  McGaw  &  Smith,  1981).  For  this  project,  research 
studies  which  reported  non-experimental  designs  were  set  aside  to  be  treated 
descriptively  in  order  to  provide  a  well-rounded  picture  of  what  research  is 
saying  about  distance  teaching  and  learning.  The  two  objectives  of  the  study 
were  to  identify  research  categories  which  recurred  in  the  literature  and  to 
design  a  model  for  the  data  analysis. 

METHOD  ^ 

Seven  resources  were  manually  searched  for  quantitative  and  qualitative 
research  studies  in  distance  education  reported  during  the  two  years  1987-89. 
The  sources  included  £RiC  Abstracts.  The  International  Dnmimflntation  r.ontpr 
AD^ia^.  The  Amencan  Journal  of  Distance  EriuMtinn  The  Canadian  Jnnrnal 
Of  EQUCatlonal  Communication  Distance  Fdui^ation.  Educational  Rasearcher 
and  the  International  Counci!  for  Distance  Education  Bulletin  .  The  searches 
yielded  62  empirical  studies  which  met  the  criteria  established.  These  were 
entered  Into  the  database.  Bibliographies  of  the  previously  mentioned  studies 
are  currently  beinr.  searched  as  well  as  the  Amarlcan  Symposium  on  Distanna 
Education.  Dissartation  Ahstrartg  and  Daveloplnty  Distance  Education 

Analysis  of  the  articles  revealed  two  major  areas  of  inquiry  with  sub- 
categories in  each  area.  The  two  major  areas  were  Instruction  and 
Administration.  Sub-categories  under  Instruction  included  studies  which 
evaluated  LEARNING,  ATTITUDES,  and  ATTRITION.  Sub-categories  under 
Administration  included  studies  of  COST-EFFECTIVENESS  and  COURSE 
DESIGN.  The  largest  category  of  research,  LEARNING,  reported  performance 
gains,  learning  styles,  learning  format,  and  age  and  gender  differences.  The 
second  area,  ATTfTUDES,  reported  attitudes  and  motivation  of  teachers  and 
students  by  age  and  gender.  The  third  sub-category,  ATTRITION,  included 
demographics  of  drop-outs  or  early-leavers,  and  provided  general  student 
characteristics.  Studies  under  Administration  reported  in  the  areas  of  COST- 
EFFECTIVENESS,  bv  h  operating  and  start-up  costs,  and  COURSEWARE 
DESIGN,  which  evaluated  the  use  of  print  and  non-print  materials  for 
instruction.  Of  the  62  articles,  approximately  half  met  the  criteria  for  meta- 
analysis. The  remaining  studies  will  be  evaluated  descriptively  to  provide 
additional  substantive  information  about  programs  and  course  design. 

The  second  objective  of  this  pilot  phase  of  the  project  was  to  design  the 
database  and  apply  a  meta-analytic  model  to  one  of  the  identified  research 
categories.  In  the  future,  data  will  be  collected  and  meta-analyses  applied  to 
the  other  identified  research  areas. 

ANALYSIS 

The  accumulation  of  research  in  education  offers  a  challenge  to  the 
researcher  to  synthesize  and  interpret  conflicting  results.  The  systematic 
approach  offered  by  meta-analysis  has  been  popularized  by  Glass  et  al.  (1981) 
and  offers  a  systematic  and  rigorous  approach  to  standardizing  research 
findings.  The  recent  development  of  Apple™  Computers'  program  HyperCard™ 
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offers  a  user  friendly  database  for  conducting  the  analysis.  In  this  case,  the 
program  HyperCard™  was  used  to  automate  many  of  the  routine  features  of  the 
meta-analysis.  HyperCard  ™  serves  three  key  features  in  this  analysis.  First,  it 
provides  the  format  for  a  database  of  the  surveyed  articles.  This  includes 
important  citation  information  such  as  author,  title,  journal  and  publisher  as  well 
as  subject  descriptors.  Second,  each  reference  is  connected  to  an  abstract. 
Third,  each  reference  is  also  tied  to  a  stack  in  which  results  of  the  study  are 
reported.  Stacks,  or  series  of  cards,  are  being  developed  to  standardize  the 
input  of  research  to  allow  the  researchers  to  view  a  concise,  clearly  articulated 
summary  of  the  research  findings.  A  complete  automation  of  the  computations 
required  to  standardize  scores  for  the  meta-analysis  is  currently  being 
developed  as  an  integral  part  of  the  results  stack. 

The  type  of  organization  offered  by  HyperCard™  has  many  advantages 
for  the  researcher.  By  organ»4ing  the  studies  into  information  fields,  i.e.,  author, 
title,  etc.,  it  is  possible  to  search  or  sort  by  key  categories.  Easy  search  of  key 
words  is  possible  within  any  of  the  fields,  the  abstract,  or  the  results.  These 
features  can  become  powerful  tools  fcr  the  scholar. 

In  the  next  step,  conducting  the  meta-analysis,  the  following  procedures 
are  used.  First,  samples  are  drawn  from  the  available  population.  The  list  of 
sources  appears  above.  Second,  infomiation  is  coded  to  identify  the  research 
categories  listed  above.  Third,  statistical  computations  must  be  applied  to 
standardize  scores  and  make  meaningful  comparisons.  Results  of  each  study  in 
the  form  of  T-  tests,  F-  tests,  Chi  Square,  correlations  and  analysis  of  variance 
are  weighted  -according  to  their  effect  sizes  and  whether  they  are  truly 
experimental,  quasi-experimental  or  uncontrolled.  The  transformation  of  these 
statistics  results  in  a  common  unit  or  Product  Moment  Correlation  which 
measur9s  the  significance  of  the  research.  A  correlation  of  .5  or  above  and 
statistical  significance  of  less  than  .05  is  expected  'f  the  intervention  is  to  be 
considered  successful.  To  date,  research  categories  have  been  determined 
and  the  HyperCard™  meta-analytic  model  designed.  The  next  step  is  to  perform 
the  analysis  on  the  first  category,  leaminp. 

SUMMARY 

This  study  reports  research  in  progress  and  the  completion  of  two  steps 
in  the  synthesis  of  current  distance  education  research.  Rrst,  as  a  result  of  a 
review  of  62  studies,  five  research  categc  :ies  were  identified  as  occurring  most 
fr((quently  in  current  distance  education  literature.  These  categories  fall  under 
me  broad  headings  of  instruction  and  administration.  Next,  a  model  for 
synthesizing  the  large  volume  of  recent  research  was  developed  using  Glass  et 
al.'s  (1981)  meta-analytic  procedures.  The  model  was  designed  using 
HyperCard™  as  a  database  to  create  stacks  and  link  information  essential  for 
perfomiing  the  statistical  transformations  of  data  required  for  a  quantitative 
meta-analysis.  The  first  and  largest  category  of  research  to  be  analyzed  is  that 
dealing  with  learning.  Meta-analyses  of  research  on  attitude  and  attrition  will 
follow.  Descriptive  studies  of  course  development  and  cost-effectiveness  will 
be  analyzed  qualitatively. 
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Meta-analysis  offers  a  systematic  way  to  synthesize  research  in  this 
rapidly  growing  area  of  distance  education.  The  development  of  a  HyperCard™ 
database  facilitates  data  entry  and  subsequent  transformations.  It  is  hoped  that 
the  resulting  quantitative  synthesis  of  research,  identifying  which  interventions 
are  successful,  will  provide  international  distance  educators  with  the  necessary 
information  to  assist  them  in  developing  new  strategies  for  their  own  programs. 
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Perceived  Attitudinal  Effects  of  Various  Types 
of  Learner  Control  in  an  Interactive  Video  Lesson 


Areas  of  Past  Learner  Control  Research 

Learner  control  is  traditionally  defined  as 
allowing  the  learner  to  have  some  control  over  the 
pacing  I  sequence  I  or  content  of  an  individualized 
lesson.     This  type  of  control  is  often  contrasted  with 
program  control i  where  the  flow  of  a  lesson  is 
typically  controlled  by  a  computer  program.  This 
distinction  has  also  been  described  as  the  locus  of 
instructional  control  (Hannafin,   1984),  with  the 
control  of  instruction  being  either  external  (program 
control)  or  internal  (learner  control). 

While  a  number  of  different  research  questions  are 
possible  within  this  overall  framework,  most  studies 
have  dealt  with  differences  in  achievement  based  on  the 
availability  of  instructional  control.     Such  studies 
have  showed  both  positive  results  for  learner  control 
groups  (e.g.,  Campanizzi,   1978;  Fernald,  Chiseri,  k 
Lawson,   1975)  as  well  as  equal  results  for  learner  and 
program  control  (e.g.,  Balson,  Manning,  Ebner,  k 
Brooks,   1984/85;  Mayer,  1976;  Reiser  k  Sullivan,  1977). 

Additional  research  has  focused  on  other  factors 
that  relate  to  achievement  for  various  learner  control 
groups.     Studies  in  this  area  have  included  adaptive 
learner  control  (e.g.,  Ross  k  Rakow,   1981;  Tennyson, 
Park,  k  Christensen,   1985),  learner  characteristics 
that  relate  to  achievement  (e.g..  Fry,   1972;  Gay, 
1986),  and  .learner  control  with  advisement  (e.g., 
Hannafin,  Garhart,  Rieber,  k  Phillips,   1985;  Johansen  k 
Tennyson,   1983).     Each  cf  these  studies  has  further 
defined  those  factors  that  can  vary  the  effectiveness 
of  learner  or  program  control. 

Finally,  student  attitudes  have  been  investigated 
in  an  attempt  to  determine  systematic  attitudinal 
differences  between  various  types  of  instructional 
control.     This  research  emphasis  is  the  focus  of  the 
present  study. 

Past  Attitudinal  Research  with  Learner  Control 
While  there  have  been  a  number  of  studies 
investigating  the  ach.^evement  effects  associated  with 
various  typea  of  learner  control,  attitudinal  studies 
have  been  somewhat  limited.     The  available  research  in 
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this  area  can  essentially  be  divided  into  studies 
supporting  the  use  of  learner  control  and  those  studies 
showing  no  attitudinal  differences  between  learner 
control  and  program  (or  instructor)  control. 

Studies  supporting  learner  control.     A  number  of 
studies  supporting  the  use  of  learner  control  have  been 
described  by  researchers  in  a  variety  of  content  areas* 
For  example,  Lahey,  Hurlocki  and  McCann  (1973)  showed 
that  students  preferred  student  controlled  training 
over  programmed  controlled  by  a  ratio  of  4  to  1  in  a 
basic  Naval  electronics  course.     Lahey  et.  al.  (1973) 
also  described  the  advantages  of  student  control  with 
its  active  student  participation  and  its  simpler  lesson 
design. 

In  a  similar  way,  Fernald  et.  al.   (1975)  found 
attitudinal  results  supporting  the  use  of  learner 
control  during  instruction.     In  their  study, 
introductory  psychology  students  with  control  of  pacing 
gave  higher  course  ratings  for  one  out  of  two  courses 
compared  to  students  following  a  teacher  pace. 

Fry  (1972)  also  described  college  students 
learning  under  a  high  degree  of  student  control  as 
forming  the  most  favorable  attitudes  toward  the  method 
of  instruction.     Similar  results  were  reported  by 
Newkirk  (1973),  who  showed  slightly  more  favorable 
attitudes  by  students  with  control  of  sequence.  The 
students  with  learner  control  also  rated  their  sequence 
as  less  restricting,  more  sensitive,  and  more 
interesting. 

Studies  not  supporting  learner  control.     While  the 
above  research  showed  learner  control  to  be  related  to 
more  positive  attitudes  toward  learning,  other  research 
has  not  shown  such  positive  ratings.     This  group  of 
studies  has  shown  learner  control  to  be  rated  equally 
with  program  control  of  instruction. 

For  example.  Reiser  and  Sullivan  (1977)  found  no 
significant  attitudinal  differences  between  a  group 
taking  quizzes  at  their  own  pace  and  a  group  using  an 
instructor  controlled  pace,  with  pacing  procedures 
well-liked  by  both  groups.     Similar  results  were 
reported  by  Judd,  Bunderson,  and  Bessent  (1970),  who 
showed  a  lack  of  improvement  in  student  attitudes  based 
on  increased  student  control. 

In  a  later  synthesis  of  learner  control  research, 
Judd  (1972)  described  finding  only  a  few  studies  with 
attitudinal  differences  supporting  learner  control 
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although  many  authors  expected  this  type  of  control  to 
result  in  more  positive  student  motivation  and 
attitudes.     In  another  synthesis  of  earlier  researchi 
Merrill  (1979)  described  no  consistent  increase  in 
attitude  toward  instruction  for  groups  with  learner 
control • 

Method 

Design  of  the  Study 

The  present  study  used  a  2  x  2  factorial  design 
with  control  of  pacing  and  control  of  sequence  as  the 
two  independent  variables.     The  dependent  variable  was 
attitude  as  measured  by  a  post-instruction 
questionnaire • 

The  first  independent  variable ,  pacing ,  had  two 
levels  —  control  by  the  student  or  control  by  the 
instructional  program.     The  second  variable i  sequence i 
also  had  two  levels  —  control  by  the  student  or 
control  by  the  instructional  program. 

vhe  dependent  variable  (attitude)  was  measured  on 
an  attitudinal  instrument  developed  by  the  researcher. 
This  instrument  was  composed  of  nine  Likert-type  items 
and  one  open-ended  request  for  additional  comments. 

Subjects 

Subjects  for  the  present  study  included  99 
undergraduate  volunteers  from  a  Principles  of 
Educational  Media  course.     Participation  in  this  study 
was  one  option  within  the  course  and  involved 
approximately  75  minutes  of  each  student's  time.  Each 
subject  received  complete  oral  and  written  instructions 
before  the  instructional  program  and  a  written 
debriefing  after  their  participation  ended. 

Instructional  Materials 

Design  of  the  instructional  materials.  The 
interactive  video  lessons  designed  and  produced  for 
this  study  covered  basic  35mm  photography  knowledge  and 
ski  Is.     Specif ically,  these  materials  consisted  of  The 
Crejitive  Camera  optical  videodisc  (1981)  and  a  computer 
program  written  by  the  researcher  entitled  "35mm 
Photography:     It's  Easier  Than  You  Think." 

The  overall  interactive  video  program  combined 
visuals  and  sound  from  the  videodisc  and  text  from  the 
computer.     The  program  was  divided  into  six  lessons 
covering  the  technical  aspects  of  a  35mm  camera i  the 
lenses  that  may  be  used  with  this  type  of  camera i  types. 
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of  available  filnif  effective  lighting  techniques, 
proper  exposure  methods p  and  photographic  accessories. 

All  instructional  materials  were  pilot  tested  by 
subject  matter  experts  in  instructional  design, 
photography,  and  educational  software.  Additional 
pilot  testing  consisted  of  presenting  the  instructional 
materials  to  twelve  undergraduate  students  of 
approximately  the  sane  age  and  grade  level  as  the  final 
learners  co  assess  the  appropriateness  of  the  materials 
for  these  learners,  the  readability  of  directions, 
overall  time  considerations,  and  other  relevant 
details • 

Learner  control  options  in  the  materials*  The 
design  of  these  interactive  video  materials  allowed  for 
either  program  or  learner  control  of  pacing  as  well  as 
program  or  learner  control  of  sequence.     The  four 
treatment  groups  therefore  included:     learner  control 
of  pacing  and  sequence,  learner  control  of  pacing/ 
program  control  of  sequence,  program  control  of 
pacing/learner  control  of  sequence,  and  program  control 
of  pacing  and  sequence. 

Learner  control  of  pacing  and  sequence  allowed 
learners  to  control  the  instructional  program  as  it  was 
viewed.     Students  in  the  learner  control  cf  pacing 
groups  were  able  to  control  pacing  by  pressing  a 
computer  key  when  finished  with  each  text  page. 
Learner  control  of  sequence  was  accomplished  by 
allowing  students  to  choose  the  order  of  the  six 
lessons  to  be  presented. 

Program  control  of  pacing  and  sequence  was  carried 
out  by  the  instructional  system  without  input  from  the 
learner.     Subjects  under  program  control  of  pacing  saw 
text  screens  only  for  a  short  period  of  time,  as 
determined  by  the  amount  of  text  on  a  given  screen. 
Partially  based  on  the  work  of  Belland,  Taylor, 
Canelos,  Dwyer,  and  Baker  (1985),  each  subject  was 
allowed  one  second  for  each  line  of  text  on  a  screen 
plus  thirteen  seconds  of  mental  processing  time  for  the 
passage.     All  subjects  under  program  control  of 
sequence  saw  the  instructional  lessons  in  a 
predetermined  order  (as  originally  determined  by  the 
researcher)  and  had  no  control  over  the  sequence  of 
their  presentation. 

Atti tudinal  Instrument 

Design  of  the  attitudinal  instrument.  The 
instrument  was  composed  of  nine  Likert-scale  items  and 
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one  open-ended  question.     The  same  form  of  this 
questionnaire  was  given  to  all  subjects ,  regardless  of 
treatment  group.     Questions  on  the  instrument  included 
attitude  toward  the  instructional  program i  student 
enjoyment  I  and  beliefs  about  pacing  and  sequence. 
Table  1  shows  a  list  of  the  Likert  items  included  on 
this  survey.     The  open-ended  question  allowed  subjects 
to  add  any  additional  comments  concerning  the 
instructional  program. 

Pilot  testing  of  the  instrument.     Pilot  testing  of 
the  attitudinal  questionnaire  was  carried  out  by 
subject  matter  experts  and  learners  similar  in  age  to 
the  final  subjects.     Specific  topics  in  this  testing 
included  question  readability  and  content,  directions 
for  use  I  and  appropriateness  of  all  questions  for  each 
treatment  group. 

Procedure 

All  six  modules  were  viewed  individually  by  each 
student  in  an  area  easily  accessible  by  all  subjects. 
Each  session  included  the  instructional  materials  given 
through  the  interactive  video  system  and  the 
attitudinal  survey  instrument. 

After  the  instruction  segments  had  been  viewed  in 
their  entirety i  the  subjects  were  instructed  to  fill  in 
the  attitude  questionnaire  that  they  had  been  given 
earlier.     The  data  from  the  questionnaire  helped 
determine  students'  perceptions  of  each  learner  control 
option  and  overall  attitudes  toward  the  use  of 
interactive  video  for  this  instruction. 

Results 

Results  Pertaining  to  the  Likert  Items 

Table  2  provides  the  means  and  standard  deviations 
for  all  items  on  the  attitudinal  survey.     For  each 
itemy  the  Likert  scale  ranged  from  1  for  strongly 
disagree  to  6  for  strongly  agree.     As  can  be  seen  from 
this  table  I  the  data  generally  showed  increased 
positive  attitudes  for  those  groups  with  learner 
control . 

Table  3  shows  the  results  of  a  multivariate 
analysis  of  variance  comparing  differences  across  all 
items  for  pacing,  sequence i  and  the  interaction  between 
these  variables.     This  table  shows  sequence  to  be  the 
only  significant  factor  for  this  analysis. 
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Table  4  shows  the  univariate  analyses  of  variance 
for  each  treatment  group  and  their  interaction  effects. 
For  these  analyses ,  control  of  pacing  was  shown  to  be 
related  to  the  subjects'  perception  of  the  pace  of  the 
materials  (See  Figure  4),  with  subjects  under  learner 
control  rating  the  pace  of  the  program  significantly 
more  positively  (F=5.64,  p=.020,  effect  size  =  .48)' 

Control  of  sequence  was  also  shown  to  be  a 
significant  factor,  related  to  students'  ideas 
concerning  whether  this  type  of  control  should 
generally  be  available  in  instructional  segments 
(F=13.44,  pr.OOO,  effect  size  =  .72)   (See  Figure  5). 
This  significant  relationship  indicates  thet  subjects 
with  control  of  sequence  tended  to  agree  with  the 
statement  that  students  overall  should  be  given  this 
type  of  control. 

Results  Pertaining  to  the  Open-Ended  Question 

As  part  of  the  attitudinal  questionnaire,  each 
subject  was  also  asked  for  additional  comments 
concerning  the  instructional  program.     Of  the  99 
subjects  who  completed  the  survey,  44  answered  this 
additional  question,  with  answers  obtained  from 
subjects  in  all  treatment  groups.     Overall,  these 
comments  included  comments  about  the  availability  of 
pacing  control,  concerns  about  the  availability  of 
sequence  control,  and  statements  about  the 
effectiveness  of  the  instructional  system. 

For  this  open-ended  question,  students  under 
program  control  of  pacing  (where  the  computer  set  the 
pace  for  the  materials),  often  described  the  computer 
screens  as  too  long  or  the  entire  program  as  too  slow. 
Other  subjects  under  program  control  of  pacing 
described  the  program  as  boring  or  expressed  a  desire 
to  be  able  to  control  the  presentation  speed.  Answers 
from  subjects  in  the  learner  control  of  pncing  groups 
did  not  include  comments  about  the  pace  of  the  program. 

In  general,  subjects  made  little  mention  of 
sequence  control  in  their  answers.     The  comments 
generally  concerned  the  difficulty  of  making  sequence 
choices  (subjects  in  learner  control  groups)  and  the 
desire  to  be  able  to  return  to  a  section  for  review 
(learrers  under  program  control). 

Positive  comments  concerning  the  use  of 
interactive  video  for  teaching  photography  included 
statements  about  the  high  interest  level  of  the 
materials,  the  informative  nature  of  the  program,  and 
the  effective  combination  of  the  computer  material  and 
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the  videodisc*     Negative  comments,  however ,  included  a 
description  of  the  abrupt  transitions  between  the 
computer  and  video  scenes,  a  preference  for  the  motion 
cr  sound  of  the  videodisc  o\er  the  textual  materials 
from  the  computer,  and  a  concern  that  too  much 
information  was  presented  during  the  program. 

Discussion 

Attitudes  Toward  Learner  Control 

Overall,  the  above  results  support  earlier 
research  which  has  demonstrated  mixed  effects  from 
attitudinal  studies,  showing  both  positive  effects  from 
learner  control  and  no  change  as  compared  to  program 
control.     This  combination  of  effects  was  shown  for 
both  types  of  learner  control  (pacing  and  sequence) 
investigated  in  the  present  study. 

Specifically,  control  of  pacing  was  shown  to  be 
significantly  associated  with  students'  perceptions 
concerning  the  pacing  of  the  materials  in  the 
instructional  program.    This  relationship  showed  higher 
attitudinal  ratings  for  the  pace  of  the  program  from 
those  students  with  pacing  control.     Answers  to  the 
open-ended  question  also  supported  this  relationship, 
with  a  number  of  negative  comments  concerning  the  pace 
of  the  instruction  from  those  subjects  under  program 
control  of  pacing. 

Control  of  sequence  was  also  significantly  related 
to  one  item  on  the  survey,  with  a  relationship  shown 
between  this  type  of  control  and  the  students' 
perceptions  that  learners  should,  in  general,  be  able 
to  control  the  sequence  of  an  instructional  segment. 
For  this  analysis,  the  importance  of  sequence  control 
was  rated  higher  by  subjects  who  had  control  of 
sequence  in  the  present  study.     Analysis  of  the  open- 
ended  question,  however,  showed  little  difference 
between  the  groups  with  different  types  of  sequence 
control. 

Specific  learner  control  options  were  therefore 
well-liked  (or  were  thought  to  be  important  overall)  by 
the  subjects  in  this  study.     However,  this  increased 
positive  attitude  was  not  shown  by  subjects'  attitudes 
toward  the  overall  program,  where  no  statistical 
differences  were  shown  between  the  learner  and  program 
control  groups.     Thus,  while  subjects  liked  the  learner 
control  or  thought  it  to  be  important,  these  results 
were  not  reflected  in  more  positive  perceptions  of  the 
overall  program  by  those  subjects  with  learner  control. 
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One  reason  for  this  lack  of  significant 
differences  concerning  the  overall  learning  process  may 
have  been  the  previous  history  of  r'-ese  learners  who 
might  have  had  little  opportunity  in  the  past  for 
taking  control  of  their  own  learning.     Learner  control 
might  have  been  three ^ening  to  these  students  since 
such  control  typically  is  not  available  in  most 
learning  situations. 

Attitudes  Toward  the  Interactive  Video  System 

Student  attitudes  toward  the  use  of  the 
interactive  video  system  were  consistently  high  across 
all  groups,  with  students  giving  high  ratings  to  the 
use  of  the  videodisc  and  generally  to  the  text  from  the 
computer.     This  support  was  reflected  both  in  the 
Likert  items  and  the  open*ended  question. 

However,  there  were  no  statistical  differences 
concerning  the  interactive  video  system  based  on  the 
type  of  instructional  control.     This  lack  of 
significance  may  have  been  due  to  potential  overriding 
positive  effects  from  the  use  of  interactive  video, 
which  was  seen  by  subjects  in  all  groups  as  a  very 
effective,  pleasing  learning  environment.     In  this 
respect,  the  use  of  this  medium  may  have  macked  any 
true  differences  simply  because  interactive  video  was 
significantly  different  from  other  types  of  learninfc 
systems  previously  used  by  these  learners. 

Summary 

The  above  results  have  shown  the  attitudinal 
effects  of  various  types  of  learner  control  in  an 
interactive  /ideo  lesson.     While  general  effects  were 
not  found,  t.>e  study  did  show  differences  in  attitudes 
toward  specific  types  of  instructional  control. 
Further  research  should  identify  additional  attitudinal 
items  that  can  be  used  to  better  understand  differences 
between  learner  and  program  control  and  the  overall  use 
of  interactive  video. 
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Table  1 

Attitudinal  Questions  Answered  by  Research  Subjects 


1.  I  enjoyed  learning  about  35iDin  photography  with  this 
program. 

2.  I  learned  a  great  deal  about  35inin  photography  with 
this  program. 

3.  I  liked  the  sequence  of  the  materials  in  this  lesson 
on  35mm  photography. 

4.  I  liked  the  pacing  of  the  materials  in  this  lesson 
on  35mm  photography. 

5.  I  think  students  should  be  able  to  select  the 
sequence  of  the  materials  they  are  studying. 

6.  I  think  students  should  be  able  to  control  the 
presentation  speed  of  the  materials  they  are 
studying c 

7.  I  liked  the  motion  segments  from  the  videodisc. 

8.  I  liked  the  text  segments  from  the  computer. 

9.  I  would  like  to  use  this  interactive  video  system 
again  if  other  materials  were  available. 


Likert  Scale: 

1  =  Stror.gly  Disagree  6  =  Strongly  Agree 
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Table  2 

Means  and  Standard  Deviations  of  Attitude  Survey  Items 

Learner  Control  Program  Control 

Item  Number  Pacing    Sequence      Pacing  Sequence 


Item 

1 

4.78 

4.80 

4.66 

4.64 

(1.17) 

(1.00) 

(1.14) 

(1.29) 

Item 

2 

4.50 

4.51 

4.47 

4.46 

(1.26) 

(1.04) 

(1.10) 

(1 .30) 

Item 

3 

4.83 

4.63 

4.57 

4.74 

(1.12) 

(1.15) 

(1.12) 

(1.10) 

Item 

4 

4.65 

4.45 

4.08 

4.24 

(1.14) 

(1.16) 

(1.21) 

(1.25) 

Item 

5 

4.30 

4.73 

4.13 

3.70 

(1.43) 

(1.50) 

(1.59) 

(1.36) 

Item 

6 

5.09 

5.04 

4.9 

4.98 

(1.17) 

(1.37) 

(1.29) 

(1.10) 

Item 

7 

5.22 

5.22 

5.21 

5.20 

il.21) 

(1.21) 

(1.12) 

(1.11) 

Item 

8 

4.52 

4.47 

4.38 

4.42 

(1.33) 

(1.19) 

(1.13) 

(1.26) 

Item 

9 

5.04 

5.00 

4.77 

4.80 

(1.26) 

(1.26) 

(1.22) 

(1 .23) 

Item 
Item 
Item 
Item 
Item 
Item 
Item 
Item  8 
Item  9 


Enjoyed  Learning  1  Strongly 

Learned  a  Great  Deal  Disagree 
Liked  the  Sequence 

Liked  the  Pace  6  =  Strongly 

Students  Should  Control  Sequence  Agree 
St  jdents  Should  Control  Pace 
Li\ed  Motion  Segments 
Liked  Text  Segments 
Would  Like  to  Use  Again 
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Table  3 

Multivariate  Analyses  of  Variance  of  Attitude  Survey 
Items  for  Type  of  Pacing  and  Type  of  Sequence 

Multivariate  Tests  Using  Pillais  Criterion 

Effect      Value    Exact  F    Hypoth>  DF    Error  DF  Signif 

Pacing        .108  1.18  9.00  87.00  .320 

Sequence     . 175  2 .05  9.00  87.00  .043 

Pacing  by  .092  .98  9.00  87.00  .461 
Sequence 
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Table  4 

Univariate  Analyses  of  Variance  of  Attitude  Survey 


Univariate  Tests  of  Significance  for  Pacing 

Variable    Hyp.  ^JS    Err.  SS    Hyp.  MS    Err.  MS    F  Signif 


Item 

1 

.33 

127.17 

.33 

1.34 

.25 

.622 

Item 

2 

.02 

134.31 

.02 

1.41 

.01 

.913 

Item 

3 

1 .75 

120.20 

1.75 

1 .27 

1.38 

.243 

Item 

4 

7.91 

133.24 

7.91 

1 .40 

5.64 

.020 

Item 

5 

.37 

193.80 

.37 

2.04 

.18 

.673 

Item 

6 

.50 

143.84 

.50 

1 .51 

.33 

.568 

Item 

7 

.00 

130.49 

.00 

1.37 

.00 

.971 

Item 

8 

.50 

145.89 

.50 

1.54 

.32 

.571 

Item 

9 

1.67 

148.23 

1.67 

1 .56 

1.07 

.304 

Univariate  Tests  of  Significance  for  Sequence 

Variable    Hyp.  SS    Err.  SS    Hyp.  MS    Err.  MS    F  Signif 


Item 

1 

.71 

127.17 

.71 

1 .34 

.53 

.468 

Item 

2 

.08 

134.31 

.08 

1.41 

.06 

.812 

Item 

3 

.28 

120.20 

.28 

1 .27 

.22 

.642 

Item 

4 

.77 

133.24 

.77 

1 .40 

.55 

.462 

Item 

5 

27.42 

193.80 

27.42 

2.04 

13.44 

.000 

Item 

6 

.17 

143.84 

.17 

1 .51 

.11 

.736 

Item 

7 

.02 

130.49 

.02 

1 .37 

.01 

.910 

Item 

8 

.04 

145.89 

.04 

1 .54 

.03 

.866 

Item 

9 

.90 

148.23 

.90 

1 .56 

.58 

.449 

Univariate  Tests  of  Significance  for  Pacing  by  Sequence 


Variable 

Hyp.  SS 

Err.  SS 

Hyp.  MS 

Err.  MS 

F 

Signif 

Item  1 

1.99 

127.17 

1.99 

1 .34 

1.48 

.226 

Item  2 

.34 

134.31 

.34 

1.41 

.24 

.627 

Item  3 

1.07 

120.20 

1.07 

1 .27 

.84 

.361 

Item  4 

.09 

133.24 

.09 

1.40 

.06 

.805 

Item  5 

3.89 

193.80 

3.89 

2.04 

1.91 

.171 

Item  6 

4.57 

143.84 

4.57 

3.02 

2.46 

.086 

Item  7 

.04 

130.49 

.04 

1 .37 

.03 

.862 

Item  8 

.00 

145.89 

.00 

1 .54 

.00 

.998 

Item  9 

.11 

148.23 

.11 

1 .56 

.07 

.794 
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Raconiidering  th«  R«i«arch  on  CBI  Scr««n  D«tign 

Th«  continuing  expansion  of  th«  microcomputer  into 
•chooli,  buiinaiiai,  hoipitali .  and  homai  has  created  a 
market  for  instructional  software  ranging  from  beginning 
mathematics  programs  to  sophisticated  simulations  of 
hospital  emergency  room  events.     A  review  of  these 
instructional  packages  indicates  both  affective  and  poor 
applications  of  instructional  design.     One  aspect  that  is 
often  overlooked,  however,  is  the  design  of  screen  displaye 
(Bork  1987;  Burke,  1981;  Keller,  1987).     Computer  displays 
Ca)  are  limited  to  one  page  at  a  time,  (b)  have  restricted 
backward  paging  and  review,  (c)  are  limited  to  layouts  of  40 
or  80  columns  by  24  rows,   (d)  provide  limited  cues  as  to 
lesson  length,  (e)  are  typically  limited  to  one  typeface  and 
one  or  two  typesizes,  and  (f)  offer  relatively  poor 
resolution.     In  contrast  to  the  printed  page,  however,  tha 
computer  has  the  capability  to  generate  dynamic  "pages" 
(•g.,  windows,  screen  building,  and  animation),  which  can 
be  Increased  in  number  with  a  relatively  smaller  effect  on 
distribution  costs. 

Computer  Screen  Design 

The  literature  on  computer  r*cre«n  design  tends  to 
follow  one  of  two  approaches.     The  first  approach  focuses  on 
typographical  variables  that  the  designer  can  manipulate  to 
create  an  effective  screen  design.     Based  on  research  and 
subjective  views,  several  authors  have  recommended  that 
displays  use  liberal  white  space,  double  spacing,  a  standard 
ASCII  typeface,  and  left-Justified  text  (Allessi  &  Trollip, 
1985;  Bork,  1987;  Grabinger ,  1983;  Heines ,  1984;  Hooper  & 
Hannafin,   1986).     A  second  approach  to  computer  screen 
design  is  the  manipulation  of  the  content.     One  such  method 
is  chunking  the  material  into  meaningful  thought  units  which 
are  then  presented  with  blank  (white)  spaces  bordering  each. 
Although  Failo  and  DeBlois  (1988)  suggest  chunking  as  an 
effective  means  of  designing  displays,  research  on  chunking 
and  similar  methods  have  failed  to  show  clear  advantages 
under  either  print  or  CBI  (cf .  Basset,  1985;  Carver,  1970; 
Fiebel,  1984:  Gerrel  &  Mason,  1983;  0  Shea  &  5inclalr , 
1983).     It  seems  important  to  consider  that  chunking  does 
not  change  the  instructional  content;  rather,  it  changes  the 
way  the  content  is  presented  on  the  screen. 

This  paper  will  describe  two  additional  variables 
designers  need  to  consider  when  designing  CBI  text  screans . 
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Th«  flrtt  yarlabl..  taxt  dan.lty.  n»nlpulata.  the  contaxt  of 
tha  information  pratantad.     Tha  sacond  yariabla.  tcraan 
dantity.   it  a  maaturamant  of  tha  amount  of  information 
pratantad  at  ona  tima  on  tha  tcraan.     Tha  following  tactiont 
of  thlt  papar  will  tummariza  two  ttudiat  on  taxt  danaity  and 
two  ttudiat  on  tcraan  dantity.  and  tha  final  taction  will 
provlda  guidalinat  for  datignlng  CBI  tcraan  batad  on  thata 
four  ttudiat. 


Taxt  Dantity 

Tha  rataarch  datcribad  in  thit  taction  wat  datignad  to 
idantlfy  altarnatiya  mathodt  for  ditplaying  computar  taxt. 
Itt  tpaclfic  focut  wat  on  tha  laral  of  richnatt  or  datall 
pratantad  in  taxt  ditplayt.  a  yariabla  that  wa  hava  labalad 

dantity  laval."     In  ralatad  rataarch  with  print  matarial 
R.dar  and  Andarton  (1980;  1982)  comparad  complata  chaptart 
from  collaga  taxtbookt  to  tummariat  of  tha  main  points  on 
both  diract  and  indiract  laarnlng.     Tha  tummariat  war  a  found 
to  ba  comparabla  or  tuparior  in  tha  10  ttudiat  raportad 
Thay  concludad  that  tha  tummariat  may  halp  tha  laarnar  focut 
on  tha  main  idaat  without  tha  Slttraction  of  additional 
alaborationt . 

Similar  to  Radar  and  Andarton' t  (1980;  1982)  conttruct 
tha  pratant  taxt  danaity  variabla  includat  tuch  attributat 
at  langth  of  matarial  (nunbar  of  wordt).  radundancy  of 
idaaa.  and  dapth  of  concaptual  tupport  for  tha  main  idaat 
Raading  rataarchart  hava  rafarrad  to  tuch  taxt  attributat  at 

ralcrottructura"  (Davidton  6  Kantor.  1982)  or  "taxtura" 
J^^n^  *  ^'"^      rollowlng  Radar  and  Andarton"  t 

U980J    procadura.  wa  ganaratad  low-dantlty  matarial  from 
convantional  taxt  by:     (a)  dafinlng  a  tat  of  rulat  for 
■hortanlng  tha  taxt.  (t)  having  diffarant  individualt  apply 
tha  rulat  to  tha  rawriting  of  tha  taxt.  and  (c)  raquiring 
thota  individualt  to  arriva  at  a  contansut  on  tha  final 
contant . 

Application  of  thata  rulat  to  a  taxtbook  unit 
c'-.ittlng    of  2.123  wordt  on  18  pagat  yialdad  a  low-dan*ity 
vartion  of  1.189  wordt  (a  56%  tavingt)  on  15  pagat  (a  17% 
■avlngt).     Tha  print  pagat  and  computar  framat  wara  datignad 
utlng  what  wara  tubjactivaly  datarmlnad  to  ba  tha  mott 
•ppropriata  layoutt  for  tha  contant.     Final  vartiont  of  tha 
CBI  laatont  ratultad  in  49  framat  in  tha  low-dantity  latton 
•nd  66  framat  in  tha  high-dantity  latton.     Figura  1  thowt  a 
■ampla  frama  from  tha  two  dantity  lavalt .     Although  both 
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frames  present  the  same  main  ideas,  the  high-density  version 
includes  additional  elaborations  and  supporting  context. 


Our  main  research  interest  was  evaluating  the 
effectiveness  of  the  low-density  material  for  learning.  We 
hypothesized  that,  when  used  in  CBI,  low-density  narrative 
would  promote  better  learning  and  more  favorable  attitudes 
by  reducing  reading  and  cognitive  processing  demands  of  the 
screen  displays.     A  second  area  of  intereet  was  the  effect 
of  allowing  learners  to  select  preferred  density  levels  in 
the  print  and  CBI  modes.     Prior  research  on  learner  control 
(LC)  has  shown  positive  results  in  some  studies  (Judd, 
Bunderson,  &  Bessent,  1970),  while  more  recent  findings  have 
been  negative  (Carrier.  Davidson.  Si  Williams.  1985;  Fisher. 
Blackwell.  Garcia.  &  Greene.   1975;  Ross  &  Rakow.  1981; 
Tennyson.  1980).     In  contrast  to  the  task  variables 
typically  varied  through  learner  control  (e.g..  leeson 
length,  difficulty,  or  organization)  the  text  density 
variable  represents  a  "contextual"  lesson  property  that 
primarily  influences  how  lesson  material  appears  without 
changing  its  basic  informational  content.     Kaking  effective 
LC  choices  (i.e..  ones  that  accommodate  learning  preferences 
and  etyles)  was  therefore  assumed  to  be  less  dependent 
relative  to  these  other  variables  on  prior  knowledge  or 
skill  in  the  subject  area.     To  investigate  these  questions 
concerning  density  variations  and  learner  control,  we 
conducted  the  text  density  studies  (Morrison.  Ross.  & 
O'Dell.  1988;  Ross.  Morrison.  &  0' Dell .  1988).  summarized 
below . 

Text  Deneity:  Study  I 

Subjects  were  48  undergraduate  teacher  education  majors 
in  six  treatment  groups  arranged  by  crossing  two 
presentation  modes  (computer  vs.  print)  by  three  text 
density  conditions  (high.  low.  and  learner  control).  Main 
dependent  variables  were  different  types  of  l-^arnlng 
achlev  ment  (knowledge,  calculation,  and  transfer),  and 
lesson  completion  time. 

Results .     The  major  finding  from  Study  I  were 

1.     No  differences  in  learning  occurred  between  low- 
and  high-density  groups. 


Insert  figure  1  about  here 
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2.  Th»  hlgh-d«nfity  group,  took  34  p«rc«nt  mor«  tim« 
to  complete  the  leiion. 

3.  Within  the  print  mode,  low-deniity  text  was 
■elected  an  average  of  3,75  (out  of  5)  timet i  however, 
while  within  the  CBI  mode,  it  wai  lelected  an  average 
of  only  1.2S  timet,  the  exact  opposite  pattern. 

4.  CBI  lubjecti  judged  the  hlgh-deniity  material  ai 
slower  moving  and  low-deniity  material  ai  more 
sufficient  than  did  the  print  lubjecti. 

5.  Low-perf ormerf  in  the  learner  control  treatment  did 
not  leem  to  favor  the    low-iupport**  option  (i.e., 
low*deniity  text)  over  high  lupport . 

Text  Deneity:  Study  II 

Study  II  (Roil,  Norriion,  0  Dell ,   1988)  wai  deiigned  to 
extend  Study  I  in  leveral  wayi .     Firit,  compariioni  between 
deniity  and  preientation  model  were  repeated  uiing  much 
larger  lamplei ,  an  immediate  achievement  poitteit,  and  a 
delayed  achievement  poitteit.     Second,  the  examination  of  LC 
wai  extended  to  include  lelectioni  of  both  text  deniity 
("partial-LC" )  and  preientation  mode  ("f ull-LC" ) .     Ai  in 
Study  I,  the  partial-LC  treatment  allowed  lubJecti  to  lelect 
either  a  hlgh-deniity  or  low-deniity  text  diiplay  for  each 
print  or  CBI  leiion.     Subjecti  in  the  full-LC  treatment, 
however,  were  allowed  to  firit  lelect  either  the  print  or 
CBI  mode,  and  to  then  lelect  hlgh-deniity  and  low-deniity 
text  Within  the  lelected  mode. 

Reiulti .     The  major  findingi  from  Study  I  were 

1.  Compariioni  of  the  full-  vi .  partial-LC  conditioni 
indicated  no  lignlf leant  differencei  on  achievement, 
attitudei,  oz  density  lelectioni. 

2.  Under  CBI,  the  full-LC  group  (18.9  rain.)  took 
lignlf icantly  leii  time  than  the  partial-LC  group  (29.0 
mln.),  indicating  that  thoie  who  lelected  CBI  completed 
the  leiion  more  quickly  than  thoie  who  were  preicribed 

CBI. 

3.  In  the  full-LC  treatment,   lubjecti'   choice  of 
preientation  mode  wai  alraoit  equally  divided  between 
print  and  CBI . 
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4.     Reading  rata  was  found  to  ba  tha  only  tignlficant 
predictor  of  thaia  prafarancai:     iubjecti  lalaqting  CBI 
vara  fatter  raadari  than  thoia  who  selected  print. 

LC  subjects  in  both  groups  showed  a  general 
tendency  to  select  low-density  text  (70  vs.  30  percent) 
more  frequently  than  high-dansity  text  regardless  of 
presentation  mode. 

Discussion 

Similar  to  Study  I.  the  highest  achievement  scores  were 
obtained  by  the  LC  group,  but  this  time  the  effect  was 
consistent  across  CBI  and  print,  and  statistically 
significant  on  three  of  the  four  measures  (calculation, 
transfer,  and  delayed  retention).     The  CBI  group  (25.8  min.) 
took  Significantly  more  t^me  than  the  print  group  (21.5 
min.).  and  the  high-density  group  (26.5  min)  took 
significantly  more  time  than  the  low-density  group  (21.0 
min) . 

The  significant  time  savings  but  comparable  achievement 
using  low-density  as  compared  to  high-density  materials  was 
consistent  with  the  results  of  Study  I.     The  LC  comparisons 
further  suggested  that  learners  are  capable  of  making 
adaptive  decisions  when  selecting  contextual  lesson 
attributes  suoh  as  presentation  mode  or  text  density  level. 
This  finding  is  in  contrast  to  the  negative  results  from  LC 
applications  which  required  learners  to  select  the  sequence, 
difficulty,  or  amount  of  instructional  support  needed  to 
achieve  objectives  (Hannafin.  1984). 

Screen  Density  as  a  Design  Variable 
Prior  research  on  typographical  variables  and  content 
manipulation  have  provided  useful  guidelines  for  screen 
design;  however,  they  have  not  addressed  the  issue  of  how 
much  information  the  expository  frame  should  contain.  We 
call  this  variable  "screen  density"  as  differentiated  frow 
text  density  (Morrison.  Ross,  &  O'Dell.  1988;  Ross. 
Morrison.  SiO'Dell.  1988)    For  example,  the  International 
Reading  Association  Computer  and  Technology  Reading 
Committee  (1984)  reconnends  using  "clear  and  legible** 
displays  with  "appropriate  margins  and  interline  spacing" , 
but  provides  no  operational  guidelines  or  specifications  to 
define  these  qualities.    To  provide  designers  with  clearer 
zecomnendations  for  optimum  density  levels,  the  screen 
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density  construct  must  bs  opsrationalizsd  and  prscisjly 
dsfinsd. 

0ns  nsthod  of  svaluating  scrssn  dssigns  is  to  v^.alcv«lata 
ths  dsnsity  of  ths  total  scrssn  by  dstsrmining  how  ni^ny  of 
ths  scrssn  spacss  ars  contain  a  charactsr  or  ars  adjacsnt  to 
a  charactsr  (Tullis,  1983).     Hunan  factors  rsssarch  suggssts 
that  psrfornancs  srror  ratss  incrsass  as  ths  dsnsity  of  a 
display  incrsasss  (Burns,  1979,  Coffsy,  1961;  Kackworth. 
1976;  Ringsl  and  Hannsr ,  1964).     Rsssarch,  howsvsr ,  on  tha 
uppsr  limit  of  scrssn  dsnsity  has  yisldsd  disparata 
rsconnsndations  ranging  from  15%  .Danchak,  1976)  to  31.2% 
(Smith,  1980.  1981,  1982)  all  ths  way  to  60%  (NASA,  1980). 

Anothsr  rsssarch  focus  was  ths  possibls  influancs  of 
ths  typa  of  matsrtal  prsssntsd  on  how  diffsrsnt  sczssn 
dasigns  wsra  yiswsd.     For  sxampls ,  Grablngsrs  (1983) 
svidancs  for  supporting  low  dsnsity  scrsans  was  obtainad 
using  a  typographical  notation  dsvslopsd  by  Twynan  (1981)  to 
craata  a  contsnt-frss  scrssn  rsprsssntation  of  a  CBI  scrssn. 
In  contrast,  judgments  of  realistic  roatsrials  would  appsar 
to  dsmand  grsatar  awarsnsss  of  and  rsliancs  on  contsxtual 
propsrti(  ,  (s.g.,  proxiinal  supporting  tsxt)  that  helps  to 
incrsass  the  meaning  of  ths  information  bsing  rsad.  Thus, 
it  is  not  clsar  that  prsf srsncss  for  low-dsnsity  scrssns 
sinllarly  apply  to  rsalistic  lesson  matsrials.  sspscially 
sines  ths  low-dsnsity  dssigns  prsssnt  ths  matsrlal  in 
smallsr  thought  units  and  conssqusntly  also  nscsssitate  an 
increassd  numbsr  of  Issson  f ramss .     We  expected  that  with 
fixed  content  and  realistic  displays,  prsf srsncss  for 
lowsr-dsnsity  scrssns  ifould  not  bs  as  high  as  soiis  of  ths 
prsYious  rssearch  in  the  instructional  dssign  litsrature 
would  suggsst.     A  third  rsssarch  intsrsst  war  ths 
prsf srsncss  of  ussrs  diffsring  in  dsgrss  of  CBI  sxpsrisncs, 
namsly  graduats  instructional  dssign  studsnts  vsrsui 
undsrgraduats  sducation  studsnts  (Ross.  Morrison.  0  Dell,  6 
Schults.  1988). 

Screen  Density:  Study  I 

Subjscts  wsrs  23  graduats  and  23  undsrgraduats 
education  majors  who  voluntssrsd  to  participats  in  ths 
study.     A  pairsd-comparison  dssign  (Nunnally.  1967)  was 
smploysd  involving  a  total  of  six  uniqus  pairings  of  four 
dsnsity  Isvsls  prsssntsd  on  an  Appls  lis  monochroms  scrssn. 
For  sach  of  ths  six  comparisons,  subjscts  wsrs  prssented 
with  two  different  scrssn  dssigns  and  asksd  to  indicats 
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th«ir  pr«£«z«nc«.     Thm  tlx  contparitont  and  tha  two  dantity 
lavali  within  aach  wara  praiantad  in  a  random  ordar . 

Ragulti .     labia  1  ihowi  tha  proportion  of  subjacta  who 
lalactad  aach  daniity  laval  whan  pairad  with  aach  of  tha 
altarnativa  lavali.     Thaia  proportion!  raflact  a  curvllinaar 
pattarn.  with  prafarancai  tanding  to  favor  tha  two  middla 
daniity  Xavali  (aipacially  tha  3lH  laval)  ovar  tha  lowait 
C22H)  and  hlghait  (53%)  lavali.     Spacif ically ,  tha  31H  laval 
wai  farorad  by  tha  majority  of  lubjacti  (from  52  to  74 
parcant)  ovar  aach  of  tha  othar  thraa  lavali;   tha  26H  laval 
wai  favorad  by  tha  majority  (54  to  56  parcant)  ovar  aach  of 
tha  two  axtrama  lavali . 


Inaart  Tabla  1  about  hara 


Tha  abova  raiulti  provida  information  on  how  tha 
individual  danilty  lavali  war a  Judgad  ralativa  to  ona 
anothar.     A  lomawhat  dlffarant  quaition  concarni  whathar  or 
not  ovarall  prafarancai  tandad  to  favor,  ai  tha  litaratura 
iuggaiti,  lowar-daniity  ovar  highar-dansity  daiigni . 
Howavar »  tabulationi  acroii  lubJacti  on  tha  six 
pairad-compariion  triali  indicatad  tha  oppoiita  pattarn:  1S6 
(57  parcant)  lalactioni  favorad  tha  hlghar  daniity  daiign 
wharaai  only  120  (43H)  favorad  tha  lowar  daniity  daiign. 

Summary.     In  contrait  to  racoramandationi  in  tha 
litaratura  (Allaiii  &  Trollip.  1985j  Bork.  1984.  1987; 
Grabingar.  1983;  Halnai  .  1984;  Hoopar  &  Hannafin.  JL986)  for 
daiignlng  lowar  daniity  icraani .  thaia  raiulti  ihowad  that 
lubjacti  tandad  to  prifar  hlghar-daniity  icraans.  Tha 
ralativaly  itrongar  prafarancai  for  tha  31H  (intarmadiata) 
daniity  laval  may  luggait  that  lubJacti  wara  attampting  to 
balanca  aaithatlc  propartiai  (i.a..  parcaivad  raadability 
and  appaal  of  tha  icraan)  with  aithar  both  (a)  tha  dagraa  of 
contaxtual  lupport  and  (b)  tha  numbar  of  icraani  in  tha 
laiion.     If  tha  lattar  wara  tha  kay  factor,  than  prafarancai 
for  tha  lowar  daniity  (mora  ipacioui)  daiigni  would  laam 
likaly  to  incraaia  if  Judgmanti  wara  to  ba    baiad  on  only 
tha  firit  icraan  of  aach  icraan  daniity  laval  ai  in 
Grabingar'i  (1983)  itudy.     Study  II  wai  conductad  to  tait 
thli  intarpratation. 


'3P.S 
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Scr<Ti  Daniitv:  Study  II 

Th«  priiaary  int«r«gt  in  Study  II  wag  to  d«t«rmln« 
raplicability  c£  th«  Study  I  raiulti  whan  only  tha  firit 
•craan  of  aach  daniity  laval  wai  praiantad.     It  wai 
pradictad  that  in  thli  caia,  itrongar  prafaranca  for  tha 
lowar  daniity  icraani  would  ba  indicatad  than  in  Study  I, 
•inca  raductioni  in  daniity  laval  would  not  raquira  having 
to  raviaw  a  graatar  munbar  of  f  raraai  . 

Subjacti  wara  27  graduata  and  12  undargraduata 
aducation  majori  who  voluntaarad  to  participata  in  tha  « tudy 
and  had  not  participatad  in  Study  I.     Tha  lema 
pairad-conpariion  daiign  ai  in  Study  I  wai  amployad .  Tha 
itimului  matariali  wara  tha  lana  ai  uiad  in  Study  I  with  ona 
changa.     Only  tha  first  icraan  for  aac.  daniity  comparicon 
wai  praiantad. 

R5iult£.     Tha  proportion  of  lubjacti  who  lalactad  9ach 
daniity  laval  in  tha  laparata  coropariioni  ii  ihown  in  Tabla 
II.     Hara,  in  compariion  to  tha  curvilinaar  trand  of  Study 
1.  tha  pattarn  ii  diractly  linaar ,  with  tha  hlghar-daniity 
daiign  coniiitantly  prafarrad  ovai:  tha  lowar- daniity  daalgn. 
Acroia  all  compariioni,  lubJacti  choia  tha  hlghar-daniity 
daiign  145  (62  parcant)  tinai  and  tha  lowar-daniity  daiign 
only  89  (38  parcant).     Thui .  comparad  to  Study  I.  whlla  no 
particular  daniity  laval  anargad  as  lignlf icantly  nora  or 
lam  daiirabla  than  ©than,  thara  wai  an  avan  itrongar 
tandancy  to  lalact  hi jhar- daniity  daiigni  in  tha  pairad 
compariioni . 

Diicuiiion 

Our  itudiai     n  taxt  daniity  and  icraan  daniity  luggt -t 
two  additional  variablai  to  coniidar  whan  daiignlng  CBI  1 axt 
icraani.     ririt,  low-daniity  format  ii  a  viabla  altarnativa 
to  tha  itandard  taxt  format  uaad  in  printad  matariali.  A 
fraroa  daiignad  with  low-daniity  taxt  can  incorporata  whlta 
ipaca*  doubla-ipacing.  and  haadingi  adaquataly  in  a  lingla 
frama.     Thli  laanar  taxt  format  providai  tha  daiignar  with 
tha  ipaca  naadad  to  organlza  taxt  which  incraaiai  iti  viiual 
appaal  (Grabingar.  1985)  whlla  minimizing  tha  total  numbar 
of  icraana  raquirad  to  praiant  tha  lama  contant.     Ampla  uia 
ot  whlta  ipaca.  and  vartical  and  horizontal  typography  with 
low-daniity  taxt  will  typically  produca  .    ^nlt  of 
initruction  that  ii  comparabla  in  frama    angth  to 
high-daniity  taxt.  but  with  appr oximataly  bOH  fawar  wordi . 
Tha  raaultant  low-dantity  matarial  in  our  raiaarch  wai  raad 
faitar.  parcaivad  ai  mora  lufficiant.  arid  lalactad  mora 
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frequently  under  LC  than  the  same  text  presented  in  a 
high-density  format. 

Second,  in  contrast  to  previous  studies  and 
recommendations  in  the  instructional  design  literature 
(Allessi  6  Trollip.  1985;  Bork.  1984,  1987;  Grabinger .  1983; 
Heines.  1984;   Hooper  &  Hannafin,  1986).   subjects  indicated  a 
strong  preference  for  learning  from  high  density  screens  as 
opposed  to  low-density  screens.     These  results  suggest  that 
the  use  cf  realistic  stimulus  materials  may  produce 
different  results  than  obtained  with  nonrealistic  stimulus 
materials  (Grabinger '  s ,  1983)  or  with  informational  (e.g.. 
machine  status)  displays     (e.g..  Danchak.  1976;  Smith.  1980. 
1981.  1982).     The  combined  results  of  the  text  density 
studies  and  and  the  two  screen  density  studies  suggest  the 
use  of  lean  (low-density)  text  with  a  medium  (31%)  screen 
density.     Low-density  text  provides  the  designer  with  a 
means  of  reducing  the  total  amount  of  text  in  the  leison. 
The  medi:uii  density  level  provides  a  balance  between 
aesthetic  appeal  and  an  appropriate  amount  of  context. 

Future  research  on  CBI  screen  designs  should 
investigate  the  use  of  text  density  and  var>  ng  screen 
density  with  different  content  areai  and  tasks  with 
different  processing  demands.     Other  research  should 
investigate  the  application  of  both  low-density  text  and 
varying  screen  densities  to  online  help  screens  where  the 
purpose  is  more  for  review  of  the  iJeas  as  opposed  to 
instruction. 


CBI  Scr««n  D«tign 


11 


R«£«r«nc«t 


Anlron.  M.R.  &  Jomi  .  B.F.  (182).     Toward  a  naw  dafinitAon 
of  raadability.     Educational  Piycholoqiit .  17.  13-'iO. 

Allafii,  S.M.  &  Trollip.  S.R.  (198S).     Coraputar -baiad 
initructlon:     Mathodi  and  davalopraant .  Englawoori 
Cliffi,  NJ:     Prantica-Hall,  Inc. 

Battat,  J.H.  (198S).     A  companion  of  tha  comprahanmon  of 
chunkad  and  unchunkad  taxt  praiantad  in  two  mcdai : 
Corapufr  and  printad  paqa .     Unpubliihad  doctcral 
diiiartation,  Manphif  3tatc  Univariity. 

Bork.  A.  (1984).     Parional  Coraputari  for  Education. 
Cteinbridga,  MA:     Harpar  &  Row. 

Bork,  A.  (1987).     Laarninq  with  parional  coraputari .  Naw 
York:  Haipar  &  Row,  Publiihari,  Inc. 

Burka.  R.L.  (1981).     CAI  lourcabook.     Englawood  Cliffi.  N J : 
Prantica-Hall ,  Inc. 

Burni,  D.   (1979).  A  dual-taik  analyiii  of  dataction 

accuracy  for  tha  caia  of  high  targat-dif tractor 

■inilarity :  Furthar  avidanca  for  indapandant 

procaiiing.  Percaption  and  Piychophviici .  25.  185-196. 

Carriar.  C.A..  Davidion,  G. ,  aWilliarai.  M.  (1985).  Tha 

•alaction  of  initructional  options  in  a  computar-bai ad 
coordinata  concapt  laiion.  Educational  Coramunlcationi 
and  Tachnoloqy  Journal.   33,  199-212. 

Carvar.  R.P.  (1970).     Effact  of  "chunkad"  typography  on 
raaaing  rata  and  comprahansion.     Journal  of  Appliad 
Pi/choloqy.  54.  288-296. 

Coffay.  J.L.  (1961).     A  compariion  of  yartical  and 
horizontal  arrangamanti  of  alpha-nunaric 
raatarial--Expariaraant  1.     Human  Factori .   3.  93-98. 

Danchak.  M.M.  (1976).     CRT  diiplayi  for  powar  plants. 
Initrumantation  Tachnoloqy.   23.  29-36. 


ERIC 


CBI  Scr««n  D«iign 


12 


Davidson,  A..  &  Kantor.  R.  (1982).     On  tha  failura  of 

raadability  formulai  to  dafina  raadabla  taxti :     A  caia 
■tudy  from  adaptations      Raadinq  Resaarch  Quarter Iv 
17(2).  187-209.   

Faibal.  W.   (1984).     Natural  phrasing  in  tha  dalivary  of  taxt 
on  computar  scraans :     Discussion  of  rasults  and 
rasaarch  approachas.     In  C .  T.  Bonnatt  (Ed.). 
Procaadinqs  of  tha  Sixth  Annual  National  Computing 
Conf aranca.     Dayton.  OH. 

Flshar.  M.D.  .     BlacJcwail.  L,R..  Garcia.  A.B..  CiGraana.  J.C. 
(1975).     Ef facts  of  studant  r.ontrol  and  choica  on 
angagamant  in  a  CAI  arithmatic  task  in  low-incoma 
school.     Journal  of  Educat^.onal  Psychology.  67 
776-783.  — 

Garral.   H.  R..  &    Mason.   C    E.   (1983).     Computar-chunkad  and 
traditional  t -^xt .     Ra^ditq  World.   22.  241-246. 

Grabingar.  R.S.   (1983;      C'AT  taxt  dasign:     Pa vchological 

attributas  undarlvxi^g  tha  avaluation  of  mooala  of  r-^j^ 
t%xt  displays.     Unpublishad  doctoral  dissartuti 
Indiana  Univarsity. 

Grabingar.  R.S.   (1985).     Ralationshlps  among  taxt  format 

variablai  in  computar-ganaiacad  taxt.     Papor  prasantad 
at  tha  Annual  Conf aranca.  AlCT.  Las  Vaa»s .  NV.  1985. 

Hannafln.  M.J.   (1984).     Guidalinas  for  vsing  locus  of 
instructional  control  in  tha  design  of 
computar-assistad  instruction.     Journal  of 
Instructional  Davalopmant.   7.  g-Xo 

Hartlay.  J.   (1987).     Di^signing  alactronic  taxt:     Tha  rola  of 
print-basad  rasaarch.     Educational  Communication  and 
Tachnology  Journal.   35.  3-17. 

Hays.  W.L.  (1981).     Statistics  (3rd  Edition).     Naw  York: 
Holt.  Rinahart.  &  Winston. 

Hainas.  J.M.   (1984).     Scraan  dasign  stratagias  for 

computar-assistad  instruction.  Badford.  MA:  Digital 
Prass . 

Hoopar.  S..  &  Hannafln.  M.J.   (1986).     Variables  aff acting 

tha  lagibility  of  computar  ganaratad  taxt.     Journal  of 
Instructional  Dayalvpmant.   9.  22-29. 


ERLC 


.332 


CBI  Scr««n  Datign 


13 


Falio  T.  &  D.Blooif.  M.L.   (1988).     D.tignlng  a  vitual 

factori-barad  icr^^n  diiplay  interfaca :     Tha  naw  rola 

of  tha  graphic  tachnologiit .  Educational  TaehnQlortv 

28.  12-21.   

Intarnational  Raading  Aiiociation  Ccraputar  Tachnology  and 

Kaadlng  Committaa  (1984).     Guidalinai  for  aducatori  on 
uiing  coroputari  in  ichooli .     Raading  Raiaarch 
Quartarlv.  20.  120-122. 

Judd.  W.A..  Bundarion.  C.V..  &  Baiiant,  B.W.  (1970). 

Effacti  of  coraputar-baiad  initructlon  on  praraauliita 
mathainatici .     (MATHS  Tach.  Rap.  5)  Auitin.  TX: 
Unlvariity  of  Taxai .     (ERIC  Documant  Raproduction 
Sarvica  No.  ED  OS  S32). 

Kallar,  A.  (1987).  Whan  toachinai  taach.  Naw  York:  Harpar 
Si  Row,  Publiihari.  Inc. 

Mackworth.  N.H.  (1976).  Stiraului  daniity  limiti  tha  uiaful 
fiald  of  viaw.  In  R.  A.  Monty  and  J.W.  Sandari  (Edi.) 
Eya  raovamanti  and  pivchological  procaiiai.     Hillf dala. 

NJ:  Erlbaun. 


Morriion.  G.R.  ,  Ron.  S.M.  ,  fitO'Dall.  J.K.  (1988).  Taxt 
daiiity  laval  at  a  daiign  variabla  in  initructional 
diiplayi.  Educational  Communication  and  Tachnology 
Journal  36.  103-115. 

NASA.   (1980).     Spacalab  diiplay  daiign  and  coronand  uiaqa 

guidalinai .  (Raport  MSrC-PR0C-711A) .  Huntivilla.  Al : 
Gaorga  Marihall  Spaca  Flight  Cantar . 

Nunnally,  J.C.   (1967).     Piychoreatric  thaorv.     Naw  York: 
McGraw-Hill. 

O'Shaa.  L.T..  6  Sind<»lar.  P.T.   (1983).     Tha  affacti  of 
lagmanting  wri«;tan  diicouria  on  tha  riading 
coroprahaniion  of  low-and  high-parf ormanca  raadari. 
Raading  Raiaarch  Quartarly.  18,  4S8-465. 

Radar,  L.M..  &  Andarion.  J.R.  (1980).    A  companion  of  taxti 
and  thair  lummariai :     Ma  lo rial  Coniaquancai .  Journal 
of  Varbal  Laiirning  and  Varbal  Bahavior.     19.  121-134. 


ERIC 


333 


CBI  Scr««n  D«iign 


14 


R0d«,  L.M.,  &  And.rson,  J.R.  (1982).  Effects  of  spacing 
and  •nballishraantt  on  raaraory  for  tha  raain  points  of  a 
taxt.     Mamory  ard  Cognition.  14,  64-78. 

Ringal,  S.  &  Haramar ,  C.   (1964).     Information  assimlliation 
from  alphanumaric  displays:     Amount  and  dansity  of 
information  prasantad  (Tach.  Report  TRN141). 
Washington,  D.C.  U.S.  Army  Personnel  Research  Office 

(KTIS  No.  AD  6021  973). 

Ross,  S.M.   (1983).     Increasing  the  meaningf ulness  of 

quantitative  material  by  adapting  context  to  student 
background.     Journal  of  Educational  Psychology,  75, 
519-529. 

Ross,  S.M.,  Morrison,  G.R.,  fiO'Dall,  J.K.  (1988), 

Obtaining  more  out  of  less  text  in  CBI:     Effects  of 
varied  text  density  levels  as  a  function  of  learner 
characteristics  and  control  strategy.  Educational 
Cowrounlcation  and  Technology  Journal.   36,  131-142. 

Ross,  S.M.,  Morrison,  G.R.,  O'Dell,  J.K.,  &  Schultz,  C.W. 
(1988).     An  investigation  of  varying  screen  densities 
on  learner  preference.     Manuscript  submitted  for 

publication. 

Ross,  S.M.,  &  Rakow,  B.A.  (1981).     Learner  control  ve  sus 

program  control  as  adaptive  strategies  for  selection  of 
instructional  support  on  math  rules.     Journal  of 
Educational  Psychology,   73,  745-753. 

Ross.  S.M..  6  Rakow.  E.A.  (1982).     Adaptive  instructional 
strategies  for  teaching  rules  in  mathematics . 
Educational  Communications  and  Technology  Journal ,   30 . 
67-74.  ~ 

Smith,  S.L.  (1980).     Reguirements  definition  and  design  for 
the  man-machine  interface  in  C*  system  acguisition. 
(Technical  Report  ESD-TR-80-122) .     Bedford,  MA:  USAF 
Electronic  Systems  Division.     (NTIS  n'    AD  A087  528). 

Smith,  S.L.  (1981).     Man-machine  interface  CMMI) 

reguirements  definition  and  guidelines;     A  progress 
re£ort.     (Technical  Report  ESD-TR-81-113) .  Bedford, 
MA:  USAr  Electronic  Systems  Division.     (NTIS  no.  AD 
A096  705). 

Smith,  S.L.   (1982).     Use^-svste.ii  int-,face  design  for 

compute! -based  information  systems.     (Technical  Report 


ERLC 


334 


CBI  ScrM«n  D;;ii9n 


ESD-TR-82-i32).     Bedford.  MA:  USAF  Electronic  Syit«mt 
Diviiion.     CMTIS  no.  AD  AllS  8S3). 

T^nnyion.  R.D.  (1980).     Initructional  control  strat^gl^i  and 
content  itructuroi  ai  deilgn  varlablai  in  concapt 
acquiiition  uiing  conputar-baiad  initruction.  Journal 
of  Computar-Baaad  Initruction.   3,  84-90. 

Tullii.  l.S.  Cl9ei).  An  evaluation  of  alphanumar ic . 
grai^nic.  ami  color  information  digplayi .  Human 
Factor! .  23.  541-5S0. 

Tullii.  T.S.  (1983).    Tha  formatting  of  alphanunaric 

diiplayi:     A  ra  riaw  and  analyiii.     Human  Fact  on  .  25. 
657-682.    — 

Twyman,  M.  (1981).     Typography  without  wordi .  Viiibla 
Languaqa .  15.  5-12. 


335 


CRI  Scr9«n  D«gign 


16 


Tabic  1 

t>roportion  of  Tin>«g  D»niitv  Layl,  Within  Each  Paired 
Comperiion  Wara  Saiactad  in  Study  1 

Pairad  Compariion 

22%    26%       22%    31%       22%    S0%       26%    3i%       26%    S0%       31%  S0% 

-54       .26     .74       .46     .54       .35     .65       .56     .44       .52  .41 
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UbU  2 

Proportion  of  Tlatt  Dtmity  LtTtlt  Within  Etch  Ptlrtd  CoMiarlion  Wtr«  S«l«gf  ^  m 
Study  2   


Palrod  Coiparlion 


22%_26%       22%    31%       22%    S0%       26%    31%       26%    S0%       31%  50% 

.28     .72       .41     .59       .44    .56       .36     .64       .41     .59       .39  .62 


r  Th,  median  co«.sponds  to  th.  middle'trequency  scce  In  a  rankad  s« 
Of  data 

HaH  the  scores  will  be  higher 
Half  will  be  lower 


X 

Hi 

Median  

Lo 


f 

50% 
50% 


If  N.40  (40  scores),  median  =  20th  score 
If  N=17,  median  =  8.5  highest  score 

Median  corresponds  to  the  50th  percentile 

Higher  than  half  the  scores 
Lower  than  half 


and  half  will  be  lower  than  the  median. 
X  * 


Hi  50% 

Median  

Lo  50% 


t«TO  Of  '"Si'^^/^itSZTaW.  8C«e  (m  terms 

Ano«»r  wa,  0.  denning  the  median  IS  to  aay  Ihat  It  comsponds 
to  the  50th  percentile. 

and  tower  than  haW  the  scores. 
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Introductlcan 

A  growing  strvAm  oi  sktpticail,  tvvn  n»g«tiv» 
criticism  about  s»v»r«1  fund«m*nt«1  aspects  oi 
educational   technology  finds  its  way  through  the 
literature  oi  our  field.    This  criticism  sometimes  is 
barely  perceptible  amid  a  torrent  of  technicism  nearly 
everywhere,  but  it  is  there.    And  it  consi ders  whe ther  or 
not  the  technology  isn't  fundamental  1 y  mi  sconce i wed, 
errant,  even  dangerous. 

To  cite  but  one  example  of  this  kind  of  criticism, 

A.  Bowers  (1988)  studies  educational   technology  and 
computing  and  concludes  that,  "Until   teachers  reclaim 
their  moral   and  intellectual  responsibilities  to 
students,  and  educational  computing  experts  recognize 
that  the  nontechnical  educational   issues  are  the  primary 
ones  yet  to  be  adc^ressed,   it  is  likely  that  the 
educational  use  of  computers  will  be  driven  by  the  forces 
of  the  marketplace  and  by  cultural  myths  Csuch  as 
progress  and  individualism,  says  Sowers]  that  put  out  of 
focus  what  we  are  doing  to  ourselves  and  our  environment" 
(p.  115). 

It  is  the  purpose  of  this  paper  to  characterize  a 
selected  few  criticisms  of  educational   technology  that  go 
beyond  the  technical    issues  and,  then,  to  offer  Habermas' 
theory  of  communicative  action  as  way  of  addressing  these 
criticisms  altogether. 

Criticisms  of  Educational  Technology 

I  begin  by  suggesting  four  strains  of  criticism  that 
appear  occasionally  in  literature  of  educational 
technology.    These  four  strains  are  about  the  following! 
conceptions  of  knowledge  and  its  uses,  post-posi t I v i st 
philosophy,  consequences  beyond  instruction,  and 
disregard  for  the  metaphysical. 

Some  authors  t^ithin  the  field  of  educational 
technology  question  our  fundamental  conceptions  of 
knowledge  and  the  uses  to  which  we  put  that  Knowledge. 
For  instance,  Koetting  <1<>83)  looks  at  the  kind  of 
knowlecig*  we  in  educational   technology  claim.  He 
describes  our  technology  as  a  scientific/behavioral  model 
of  education  that  has  a  constitutive  interest  in  control 
and  certainty  <p.  3).    He  says  our  "systems  approach  is 
based  on  an  emp i r i cal -anal yt i c  form  of  inquiry"  <p.  4) 
that  focuses  almost  exclusively  on  instrumental 
knowledge.    He  says  further  that,  "This  model  is 

reductive.. .and  oversimplifies  its  reality  This  model 

does  not  acknowledge  self-reflection  (interpretive 
understanding)  or  critical  anal ysl s. . . .A  control  model 
applied  to  education  is  an  inadequate  model  when 
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undtr«t»nding  of  human  b»h«wior  «nd  th*  Q»n»r»tion  of 
knowledge  is  our  intent"  <p.  17). 

Secondly,  the  questioning  of  knowledge  and  its  uses 
includes  «  line  of  post-posi t i v i st i c  criticism.     I  mean 
post-posi t i vi St  to  be  «n  abandonment  of  the  beliefs  that 
science  can  explain  all  human  affairs,  that  something  is 
meaningful  only  if  it  is  verified  empirically,  and/or 
that  empiricism  or  behaviorism  are  full  enough  theories 
of  human  behavior  (See  Phillips,  1983,  about 
postposi  tivism). 

Some  of  this  postposi t i v i st i c  bent  appears 
txplicitly  in  a  recent  piece  by  Taylor  and  Swartz  <1988). 
They  write  that,  "Sc i ent i f i cal 1 y  generated 
knowl edge .. .has  come  under  increasing  attack.  The 
presumed  ep i stemol ogi cal 1 y  priviledged  position  of 
knowledge  that  results  from  rigorous  application  of  the 
scientific  method  has  been  deeply — some  would  say 
mortal  ly—chal  lenged"  <p.  24).    They  point  out  that  truth 
and  knowledge  are  made,  not  discovered  by  communities  of 
learners  and,  therefore,  "Knowledge  from  conflicting 
worldviews  will  have  to  be  honored"  <p.  27)  in 
classroom*.    They  wonder,  "In  the  future,  how  will 
instructional   technology  respond  to  the  requirements  of 
fluid,  multipU  knowledge  structures  negotiated  at  the 
local   level?"  <p.  29> . 

Thirdly,  this  examining  of  knowledge  and  its  uses 
leads  beyond  the  narrower  bounds  of  instruction  and  its 
components.    Some  of  us  are  looking  at  any  deleterious 
consequences  of  our  technology  in  relation  to  its  effects 
ecology  °*  Personality,  society,  culture,  and  the 

I've  already  noted  the  work  by  Bowers  (1988)  on  this 
criticism.    And  Apple  <1987)  studies  the  soc i o-cul tural 
implications  of  educational  computing  *..d  says  th«re  is 
an  increasingly  close  relationship  between  school 
curricula  (i.e.,  knowledge)  and  corporate  needs  and  that, 

the  language  of  efficiency,  production,  standards, 
cost-effectiveness,  job  skills,  work  discipline,  and  so 
on--all  defined  by  powerful  groups  and  always  threatening 
to  became  the  dominant  way  we  think  about  school  i  ng— has 
begun  to  push  aside  conce.-ns  for  a  democratic  curriculum. 

9•t^d•r,  and  race  equality" 

In  a  fairly  recent  article,  I   identified  what  is  the 
final  strain  of  criticismi  formal  conceptions  of 
educational   technology  are  toe  opposed  to  the 
metaphysical  (Nichols,  1987)   in  humans. 

,  °*  criticism  is  similar  to  the  others 

in  that  it  acknowledges  the  positivist  nature  of 
educational   technology,  but  it  is  more  general    in  its 
claim.    Educational  technology  is  not  just  too  behavioral 
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or  tmpiriccl.     It  is  too  txtrtmtly  rationAli  it  rtlits 
too  much  on  human  rtason  gtntrally.  Conwtrsely, 
tducational   ttchnologx  is  too  oppostd  to  tht 
mftaphysiCAl  ,  that  which  is  conctrntd  with  tht  bro*c:#st 
classts  of  rtAl i ty  and  knowltdgt,  knowltdgt  which  is  not 
ttsttd  soltly  by  dirtct  stnst  ohstrvAtlon  and  which  is 
conctrntd  also  with  rtalitits  such  as  god,  soul,  frttdom 
(Randall  it  Buchltr,  1971,  p.  102).  Educational 
ttchnologists  art  not  tncouragtd  to  bt  rtsponsibit  for 
tacit  knowltdgt,   intui      -»s,  or  tutn  somt  forms  of  txptrt 
knowltdgt  (Stt  Drtyfun   .  urtyfus,  1984,  on  txptrt 
knowltdgt).     I  argut  in  this  articlt  that  tht  txtrtmtly 
rational  stanct  toward  txisttnct  distngagts  us  from  full 
conscio.  intss  and  rtsults  in  ptrsonal ,  socittal,  and 
tco logical  suf ftr  ing. 

Qranttd,  thtst  criticisms  do  not  comprist  anything 
likt  tht  bulk  of  our  littraturt,  but  thty  art  thtrt.  And 
btyond  saying  that  tach  in  its  way  qutstions  our 
conctption  of  knowltdgt  and    ts  application,  making  tht 
conntctions  among  thtm  is  we v  difficult  btcaust  thty  nay 
sttm  so  difftrtnt  rrom  ont  another,    uhat  dots  bthauioral 
psychology  haut  to  do  with  tcological  suffering?  I 
btlitgt  that  Jurgtn  Kabtrmas'  work  can  htlp  to  conntct 
and  strtngthtn  somt  of  thtst  criUcisms  of  tducational 
ttchnol ogy • 

Habtrmas^  Critical  gocig^l  Seitng# 

Htnct,  wt  comt  to  Jurgtn  Habtrmas%  whost  criti-al 
thtory  and  thtor>  of  commun  i  cat  i  i^t  action  comt  clo'  to 
addrtssing  tht  issuts  cittd  aboMt. 

First,  critical   thtory  is  attrac<i>;t  btcaust  of  its 
btlitfs  about  positivt  scitnct.    Many  in  tht  critical 
thtory  school  btlitut  that  "tht  a;  I -ptr  -ndi ng  influtnct 
of  positivism  has  rtsulttd  in  a  widis,-    ad  growth  of 
instrumtntal  rationality  and  a  ttndtncy  to  stt  all 
practical  probltms  as  ttchnical   issuts"  <Carr  &  Ktnrnis, 
1986,  p.  130).    And  as  a  critical   thtorist,  H^btrmas 
waf^ts  to  dvi^tlop  a  critical  social  scitnct  that  lits 
somtwhtrt  bttwttn  philosophy  and  scitnct.    Ht  asks  "how 
can  tht  prcTist  of  practical  politics — namtly  of 
providing  practical  oritntation  about  what  i^  right  and 
Just  in  a  giwtn  situation — bt  rtdttmtd  without 
rtl inquishing. . . tht  rigor  of  scitnti;ic  knowltdgt" 
(Habtrmas,  1974,  p.  44). 

Furthtr,  critical   thtory  is  bastd  partly  in  showing 
how  thtrt  art  stutral  kinds  of  knowltdgt.    Thtrt  is 
objtctivt,   instrumtntal  knowltdgt.    Thtrt  is  practical 
knowltdgt  in  which  ptoplt  achitut  undtrstandi ng  through 
Unguagti   this  is  a  subjtctiut  knowltdgt.    Thirdly,  thtrt 
IS  tmancipatory  knowltdgt  in  which  ptoplt  may  achitvt 
rational  autonomy  and  frttdom  in  inttlltctual  and 
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material  conditions  via  the  sci»nc»  o*  cpitiqu*  and  th» 
power  that  accompanits  it.    And  in  this  latter  kind  of 
Knowledge,  Habermas  max  be  attempting  "to  reconcile  his 
recognition  of  the  importance  of  both  'interpretive' 
understanding  and  causal  explanations.     For  example, 
although  Habermas  accepts  the  interpretive  insight  that 
social   lift  cannot  be  explained  in  terms  of 
generalizations  and  predictions,  he  also  accepts  that  the 
source  of  subjective  meanings  lies  outside  the  actions  of 
individua  s  and,  hence,  that  the  intentions  of 
individi.als  max  be  socially  constrained  or  redefined  by 
external  manipulative  agents"  <Carr  it  Kemmis,  p.  137). 

Perhjis  the  major  criticism  of  this  theory  i%  that 
It  to  provide  rational  standards  by  which  it  can 

justify  Itself,  by  which  it  can  show  itself  to  be 

better     than  other  theories  of  knowledge,  science, 
Jh^Sh^;;;  °*  responses  has  been  to  develop 

140)!  communicative  action  <Carr  tc  Kemmis,  p. 

The  Lifeuiorl^ 

Becauf*  I  believe  so  strongly  that  the  "other,"  the 
Z  Knowledge  has  been  dangerously 

f!T!Jf    ?  ^  will  deal  with  that 

I2Sr^I«l  °*  communicative  action  which 

addresses  this  "other."    Haberntas  calls  it  the 
lifeworld."    He  says  of  the  lifeworld,  "It  is  an 

knowledge  that  can  not  be  represented  in  an 
infinite  number  of  propositions;   it  is  a  holisticajl y 
t^rwcturtti  knowledge,  the  basic  elements  of  which 
intrinsically  define  one  another,  *nd  it  is  a  knowledge 

V^""^  *^  "'"^  di«Bo«iM^n,   inasmuch  as  we 
can  not  maKe  it  conscious  and  place  it  in  doubt  as  we 
•     fV.  ?*^"''"**'   »^8»/»984,  p.  336).     The  lifeworld  is 
implicit  knowledge  that  "remains  at  the  backs  of 
participants  in  communication.     It  is  present  to  them 
only  in  the  preref 1 ect i ve  form  of  taken-f or-granted 
bacKgrognd  assumptions  and  naively  mastered  skill*" 
(Habermas,  1981/1984,  p.  334). 

SAiifln.^Hty.  Coffirouniration.  and  ^f^^  ^j^^^.f^pi^ 

Bwyond  the  lifeworld,  Habermas  des^:ribes  the 
ratior^al,  which  can  mean  two  ways  i  ,1  whi.-:h  knowledge  is 
gathered  and  used.     First,  a  noncommun i cai i ve  use  of 
knowledge  connotes  the  successful  i»iai  ntenanc* 
dominance  over  a  contingent,  manipulable  environment. 

I!      cognitive-instrumental  use  of  knowledge  "that 
has,  through  empiricism,  deeply  marked  the 

1981/1984,  p.  10).     "On  this  model  rational  actions 
basically  have  the  chara'-ter  of  goal -directed. 
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^••db*ck-contPol l»d  i nt»rw»nt i on«  in  th»  world  o* 
txisting  states  oi  affairs'  <Hab»rmas,  1981/1984,  p.  12). 

Th»  communicatiw*  us*  oi  KnoMltdgv,  on  the  othtr 
hand,  mtans  conwnun  i  cat  i  v>»  compettnc*  in  th» 
"unconstrained,  unifying,  consensus-bringing  fore*  of 
argumentative  speech"  (Habermas,  1981/1984,  p.  lO). 
These  argumentative  speech  acts  functioni  to  reach 
understanding  with  one  another  «nd  so  transmit  cultural 
knowledge,  to  coordinate  social  action  and  so  fulfill 
norms  appropriate  to  a  given  social  context,  and  to 
socialize  individuals  at  the  level  of  personality 
(Haberma'-,   1981/1987,  p.  63). 

Speakers  fulfill   these  functions  via  three  kinds  of 
^kI.'.T'^k"  argumentative  speech:  the/  make  claims 

about  the  truth  of  their  expressions  in  the  objective 
world  (propositional  statements  in  an  objective  context)} 
they  make  claims  about  the  rightness,  appropriateness,  or 

'»  '*  relates  to  shared  values  and 
norms  in  the  social  world  < i 1 1 ocu t i onary  component, 
normative  context);  or  they  make  claims  about 
authenticity  of  speech  which  is  about  feelings  or 
intentions  (expressive  component,  subjective  context) 
(Habermas,  1985/1987,  p.  312). 

The  relationships  among  components  of  the  theory  are 
summarized  as  followsi  "Thus,  to  the  different  structural 
components  of  the  lifewor'id  (culture,  society, 
personality)  there  correspond  reproduction  processes 
(cultural  reproduction,  social  integration, 
socialization)  based  on  the  different  aspects  of 
communicative  action  (understanding,  coordination, 
sociation),  which  are  rooted  in  the  structural  components 
Of  speech  acts  (proposi t i onal ,  i 1 1 ocut ionary, 
expressive).    These  structural  correspondenc*^;,  permi  t 
communicative  action  to  perform  its  dif-f  -ent  fi^nctions 

fo  serve  as  a  suitable  medium  for  the  s>mbjlic 
reproduction  of  the  lifeworlcJ"  (Habermas,   198)/1984.  d. 

xxv).  '  w    ,  J,. 

^5*  oi  any  claims  about  truth,  ightness, 

authenticity  is  tested  through  argumentation,  which  does 
not  ref.r  to  deductive  logic  and  the  connections  between 
semantic  units  such  as  you  might  get  with  a 
cognitive-instrumental  use  of  knowledj.<,  hut  to 

'^•'•*'<'"*  between  pragr-atic  units  (speech 
acisp     (Habermas,  1981/1984,  p.  22).    There  are  five 
kinds  of  arguments!  theoretical  di,*course,  practical 
discourse,  aesthetic  criticism,  therapeutic  critique, 
explicative  discourse  (Habermas,  1981/1984,  p.  23). 

"The  rationality  inherent  in  this  practice  is  seen 
in  the  fact  that  a  communicatively  achieved  agreement 
must  be  based  in  tht  tnti  on  reasons.    And  the  rationality 
Of  those  who  participate  in  this  communicative  practice 
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is  dtt*rmin*d  by  wh»th»r,   ii  n»c»ss*py,  they  co  ^d,  under 
suitable  ci rcti^^^ijip^f ^ ,  provide  reasons  for  their 
expressions'  (Habermas,  1981/1984,  p.  17).  Suitable 
candltions  require  th*t  there  is  no  coercion,  but  a 
shared  i n tersubjec t i v i ty. 

So  how  are  this  rational  argumentation  and  the 
lifeworld  related  to  one  another?    "The  lifeworld  is,  so 
to  speak,  the  transcendental  site  where  speaker  and 
hearer  meet,  wi.sre  they  can  reciprocally  raise  claims 
that  their  utterances  fit  the  world,  and  where  they  c«n 
criticize  and  confirm  those  validity  claims,  settle  their 

rlof??!*!!!*"**'         arrive  at  agreements"  (Habermas, 

1981/1987,  p.  126). 

Further,  "Language  and  culture  are  constitutive  of 
the  lifeworld  itself-  (Habermas,  1981/1987,  p.  125). 
When  people  are  in  truthful,  right,  or  authentic 
communication,  they  use  language  and  culture  in  such  a 
way  that  language  and  culture,  too,  are  implicit,  are 
only  on  the  horizon,  are  only  part  of  tCe  reservior  from 
which  people  select  knowledge.     In  their  language  use, 
people  often  attend  fpore  to  consensus-building  than  to 
language  and  culture  themselves. 


Rational ization  guyiu^y 

In  this  process  of  communication,  aspects  of  the 
lifeworld  are  made  explicit,  are  rationalized. 
Structurally,  this  means  that  the  more  culture,  society, 
and  personal  ity  -get  differentiated,  the  more  interacti  n 
contexts  come  under  conditions  of  rationally  motivated 
mutual  understanding,  that  is,  consensus  formation  that 
rests  m  tht  tnti  on  the  authority  of  the  better  argument - 
<Habermas,  1981/1987,  p.  145).    This  means  that 
normative,  value-vested  contexts  are  transferred  to 
rational  yes/no  positions.    The  mythic  world  becomes 
rationalized.    Kinship  social  structures  become 

JIIh'I;;^^^'!*:.  morality  emerge  from  the  sacred 

and  become  differentiated  aspects  of  society.  The 
notions  of  a  Protestant  work  ethic  and  division  of  labor 
C«K9  hoi d ■ 

lifeworld  is  rationalized,  social  systems 
?Sr«i"  °[!?  •'"•'^«»-    habermas  gives  this  example: 

S.nce  the  eighteenth  century,  there  has  been  an 
increasingly  pedagogical  approach  to  child-rearing 
processes,  which  has  made  possible  a  formal  system  of 

Jfi;?wi°r  J"^*!  ^"""^         ""P»'^**'''»  mandates  of  church  and 
family    [which  are  less  rationalized  structures! 
<1981/1987,  p.  147) . 

As  system  complexity  increases,  not  only  is  there  a 
greater  reliance  on  communicative  consensus,  but  the 
consensus  shifts  to  more  and  more  abstract  levels.  Take 
the  case  of  Mw  and  morality.     -Actors'  motives  were  at 
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first  undtr  the  cont..*ol  of  tht  concrete  galue  orientation 
oi  kinship  rules;   ?n  the  end,  the  generalization  of 
motives  and  values  goes  so  far  that  abstract  obediengp  ^9 
iiw  becomes  the  only  normative  condition  that  actors  have 
to  meet   in  formally  organized  domains  of  actions^ 
(Habermas,   1981/1987,  p.  180). 

At  the  social   level,  one  of  the  tendencies  of  this 
generalization  and  abstraction  is  that  it  "forces  the 
separation  of  action  oriented  to  success  from  action 
oricn  .-d  to  mutual  understanding"  (Habermas,  1981/19C?, 
p.  180),  so  systems  connected  with  purposive-rational 
action,  rather  than  with  communicative  ;^c  t  i  on ,  increase. 

Media  and  the  Breakdoujn  of  Lifeuiorld  and  Consensus 

As  more  and  more  complex  social   interactions  have  to 
be  coordinated,  mechanisms  are  developed  to  reduce  the 
risks  and  failures  in  coordini^ting  mutual  understanding. 
Some  of  the  most  basic  mechanisms  are  "de 1 ingui st i f i ed 
steer i ng  media, "  such  as  prestige,   influence,  power, 
money,  and  modern  electronic  mass  media.     These  media 
coordinate  by  either  condensing  or  reolacino  mutual 
understanding  in  language  (Habermas,  1981/1987,  p.  181). 

Habermas  claims  that  soiT<e  media  can  be  successful  in 
helping  mutual  understanding  because  they  motivate  by  a 
trust  in  knowledge.     He  says,  "Where  reputation  or  moral 
authority  enters  in,  action  coordination  has  to  be 
brought  by  means  of  resources  familiar  from  consensus 
formation  in  language.    Media  of  this  kind  cannot 
uncouple  interaction  from  the  1 i feworl d  context .. .because 
they  have  to  make  use  of  the  resources  of  cons^fnsus 
formation  in  language"  (1981/1987,  p.   183).    Mfdia  such 
as  reputation  and  value  commitment  "relieve  interaction 
from  yes/no  positions  of  criticizable  validity  claifiS 
only  in  the  first  instance.     They  are  dependent  on 
technologies  of  communication  [mass  media],  because  these 
technologies  make  possible  the  formation  of  public 
spheres. . .connected  up  to  cultural   tradition  and,   i n  the 
1 ast  Instance,  regain  dependent  on  the  actions  of 
responsible  actors"  (Habermas,  1981/1987,  p.   189).  I 
suppose  a  community  newspaper  that  encourages  people  to 
argue  about  political  candidates  serves  as  an  example  of 
a  medium  being  used  for  consensus  formation. 

However,  "Media  such  as  money  and  power  attach  to 
empirical   ties|  they  encode  a  purposive-rational  attitude 
toward  calculable  amounts  of  value  and  make  it  possible 
to  exert  generalized,  strategic  influence  on  decisions  of 
other  participants  while  bypass i  no  processes  of 
consensus-oriented  communication.     Inasmuch  as  they  do 
not  merely  simplify   linguistic  communication,  but  reol ac^ 
i t  wi th  a  symbolic  generalization  of  rewards  and 
punishments,  the  lifeworld  contexts  in  which  processes  of 
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r.achtng  understanding  *r.  alwuy.  tmbtddtd  art  d.walu.d 
in  favor  o*  medi *-»t»»r»d  int»r*ct ionsj  th*  lifeworld  is 
no  longer  n.,d.d  for  th.  coordination  of  action- 
<H*b.rmM    1981/1987,  p.  183).     Further,  d.  1  i  ngu  i  st  i  f  i  .d 
m.di*  6UCI1  •«  mon.y  and  pow.r,  connect  interaction,  into 

r^^HJf"?  "°         ha.  to  conpr.htnd  or  bt 

r.«pon«,bl.  for  (Hab.rma.,   1981/1987,  p.  184). 

«  r. 1.1*5' V*^         ^••*'^"ction  of  urban  •nwironm.nt* 
JlAu;i       of  uncontrolled  capitalist  growth,  or  th. 
JxJ?J?nIl"  °"  °*         '^lucational  •ystJm,  can  b. 

J^Ll    J!  /f  *  of  m.dia.     Such  mi«u*.«  .S^^ng 

from  th*  false  perception  of  those  involved  t^.t  rational 

?58"l987t  ;    29I)  '"""•^  <Habermas, 

Note  that  neither  the  rationalization  of  the 
iic::«if,r:  system  complexity  are 

«' P:"**'""-  difficulty  is  -an  eletist 

JLi-lun  r!f  /xptrt  cultures  from  contexts  of 

commun.cat.ve  act. on  in  daily  lif*-  (Habermas,  1981/1987, 

of  thr^HfloJl'd';  ""^^^  •^•tionalization 

Sucr.I.u.!^^^?''*  understood...  in  terms  of 

successive  releases  of  the  potential  for  rationality  i» 

S^SIrlllJn'"'  oriented  lo^JrdSuiir 

understanding  gains  more  and  more  independence  from 

S?mIJd:":.""*r*'-    ^*  time,'eCer  gr.IleT 

demands  are  made  upon  this  basic  medium  of  eJeryday 
language,   ,t  gets  overloaded  in  the  end  and  repuJed  by 
del.ngu.stified  media,    when  this  tendency  toiird  In 

:ys::;::;:c*s'  v^^v'  •••  ^«p"".d*Sn  the 

levei  ot  a  systematic  history  of  forms  of  mutual 
w2?Th'J':?'"?'  J^'  "^'^••'•fble  irony  of  the 
rvii^nl      kI  °*  'nlightenment  becomes 

losTbV.  I  °*  l**»wor Id  makes 

possible  a  heightening  of  systematic  complexity,  which 
becomes  so  hyper troph i ed  that  it  unleashes  system 
imperative,  that  burst  the  capacity  "  t"  UiTor^6  they 
instrumental  iz.  (1981/1987,  p.  155).  "ttworid  they 

Imol ieatjgn* 

Uhat  do  the  critical  and  communicative  theories 
J!  T"*""*'""*'   technology?    What  do  they  say  about 

Q  uiS         •"W"*'^  •*         beginning  of  this  ^ajer? 
cit^d  iaMi.r*  °*  Ko'tting  (1983)  and  others 

?n  r«n!  '     *        ^'""^  *h**  educational   technology  is 

in  some  instances  what  Habermas  describes  as  a  sy«t.m  J 

sr;E°r::;r":cN;:n\*i  v'r-      ••p-iiri:  :h:*::sr 

?*.   "^*'°"*'  development  and  design.    At  least  it 
would  like  to  be  (See  Gagne,  1987,  p.  5??  * 
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On«  thing  this  purpo«i w»-r»t i on*l  stance  m»«ns  is 
th«t  w»  art  helping  to  rAtion*liz»  th»  li-feworld.  For 
instance,  as  w»  observe  students'  perceptions  o* 
themselves  in  relation  to  the  computer,  as  did  Turkle 
<1984),  we  are  making  explicit  that  which  was  simpi/ 
tacit  until   the  coincidence  oi  the  computer  and  the 
student  and  until  someone  decided  to  look  at  the 
relationship,  make  it  conscious.    Just  to  contribute  to 
rationalization  is  not  necessarily  good  or  bad. 

But  what  happens  ii  we  examine  educational 
te'-hnoloQists,  our  processes,  and  our  media  as  they 
relate  to  the  fullest  kinds  oi  education?    And  here  I  am 
assuming  a  correspondence  between  Habe.^mas'  aspects  oi 
•ritical  social  science  and  communication,  on  one  hand, 
and  education,  on  the  other.    That  is,  I  believe 
education  should  fu.iction,  via  communicative  action,  to 
help  us  competently  reach  understanding  with  one  another 
<the  cultural  function),  fulfill  appropriate  societal 
norms  (the  social  function),  and  develop  our 
personalities  (the  socialization  function),  and  in  the 
process,  learners  become  involved  wth  objective, 
practical,  and  emancipatory  forms  oi  knowledge.  Given 
this  assumption,  we  can  ask  about  th»  extent  to  which  our 
educational   technology  encourages  these  functions  with 
these  kinds  of  knowledge. 

From  this  point  of  view,  we  come  up  short  because 
three  of  the  needs  for  fulfilling  the  communicative 
functions  are  given  too  short  shrift.     Firstly,  we  do  not 
formally,  publicly,  admit  the  existence  of  a  lifeworld. 
But  to  Habermas  the  lifeworld  and  the  rational  world  are 
not  completely  separate.    The  lifeworld  is  not  an 
unspeakable  human  aspect.    To  exclude  formal  notice  of 
that  in  humans  which  is  only  implicit  is  short-siohted 
and  di shonest . 

Secondly,  some  educational   technologists  conceive  of 
knowledge  too  narrowly.    As  pointed  out  earlier,  some  of 
us  tend  to  focus  largely  on  objective  knowledge  used 
instrumental ly.    This  is  virtually  a  defintion  of  the 
field.    However,  Habermas  says  that  the  world,  existence, 
IS  not  simply  objective  and  instrumental.     It's  not  even 
fully  rational .    With  normative  rightness  and  subjective 
truthfulness,  the  world  is  a  relationship  of  the 
objective,  the  social,  the  subjective,  and  the  aesthetic. 
Lik-jwlse,  the  wor;d  of  education  and  educational 
technology  is  normative,  subjective,  and  aesthetic.  To 
the  degree  that  we  deny  these  kinds  of  knowledge,  again, 
-t9  are  being  short-sighted  and  dishonest. 

Thirdly,  regardless  of  the  kind  of  knowledge 
involved,  we  do  not  for  the  most  part  operate 
consensual ly.     Ironically,  our  commun i cat i ons  model s  may 
best  reveal   this.     If  we  examine  Schramm's  adaptation  of 
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Shannon'*  connnun  i  cat  i  on  model  as  it  is  described  by 

?hi;'Jl!:  U^i*?"**'  Ru*Mll   <1985,  p.  IS),  wt  art  told 

that  the  modvl  vmphasizts  that  communication  occurs  only 
whtrt  th«  fi.ids  oi  .xp.ri.nc*  ovtrlap.    This  ov.rlar 
would  app.ar  to  bt  consensual,    ulithin  th.  overlap,  it 

Tiltr^^f  PUf^Po"*  driving  the  s.nd.r's  (t.ach.r, 

instructional  d.s.gn.r,  admi nstrator ,  society,  .ct.) 
messages  are  not  always  mad*  known  to  th»  receiver 
Utarner);  the  purposes  often  lie  outside  the  overlappino 
txperiences.    The  learner  does  not  always  have  the  chance 
to  come  to  agreement  about  them.    This  is  the  eletist 
bypassing  oi  consensus  that  Habcrmas  refers  to.    To  the 
degree  that  the  driving  reasons  are  not  accessible, 
education  is  not  consensual  but  is  coercive. 

At  least  implicitly,  we  can  see  an  example  oi 
».Vr^1th't  mJoIT  '=?™P1»'<'*>'         bypassing  oi  consensus  in 
mor^I  olrJ  f    ^****"""*  technology  becomes 

3r?t!^«  P*'^^**'-*  *n  •^^•c^,  consideration 

r                       *°  ^'^^•'^  •"^  higher  levels  oi 
decision  making*  <p.  77). 

f.rh^^r  '  '^^I!'*  •''•'^^  instance  our 

A^d                   rP***  but  I  am  sure  it  happens. 

And  I  am  sure  tins  is  really  the  most  powerful  of 

"""^  ^•chnologi^st  In  what 

wmJJ  fnriT    P:°"****  ''^-P^'ing  consensus 

which  includes  the  learner? 

rf.<irT?li*"  *<'9*-';»r,  I  would  say  these  three  kinds  of 
deficits  in  our  technology  result  in  the  following  kinds 
of  consequences.    A  good  deal  of  objective  knS^l Jdge 

«c?I*^"^*'2"'  *°  •'••P  *bout  culture  and 

J^chJofooi*  ^'•"^•'^•d  •nd  passed  on  via  educational 
technology.     I  have  no  quarrel  with  this,  as  far  as  it 
??r^oh  •">*nicipatory  knowledge  gained 

communication  are  not  part  Zi  our 
exITJ      on^'?  tducational   technology,  and  to  that 

extent,  our  technology  and  the  knowledge  it  manipulates 
••meaningless  to  many  whom  it  touches  (controls').  I 
think  this  meaninglessness  is  part  of  the  reason 
educational   technology  has  never  been  adopted  to  the 
extent  possible.    This  is  why  educational  technologists 
get  left  out  of  national  reform  movements  such  as  The 
Holmes  Group. 

*onn^]  conceptions  of  educational  technology 
ItJJrHl  V  encouraging  social,  cultural,  and 

•cological    injustices.     For  instance,  schooling  and 

^•'^^"OK'O'**  help  to  reproduce  the  social 
status  quo.    Lately  this  reproducat i on  of  a  social  sort 

Again,  I  recommend  Apple  <198*)  *nd  Bowers  (1988)  on 
these  propositions.    Though  educational   technology  as  you 


350 


Habeprn**'  Theory  oi  Commun i cut i vt  Action  h 


and  I  know  it  is  ctptainly  not  responsible  -for  all  these 
ills,  I  think  we  contribute  our  -fair  sha.  e  to  them. 

Conclusion 

You  may  have  noticed  that  I  have  used  the  adjectives 
"■formal"  or  "public"  to  describe  conceptions  oi 
educational  technology  and  technologists.     I   intend  by 
these  to  mean  that  in  our  everyday  conceptions  and  uses 
of  technology  we  do  not  totally  omit  the  lifeworld  or 
consensual  communication.    We  omit  these  mostly  in  our 
formal,  public  persona.     But  to  the  degree  that  our 
thinking  and  uses  of  technology  are  influenced  by  this 
public  display,  they  may  become  predominant.    And  as  I 
have  indicated,  it's  time  to  be  extremely  skeptical, 
perhaps  even  radical,  about  predominant  conceptions  of 
our  technology. 

It  is  time,  also,  to  admit  that  the  llfeworJd 
informs  all  aspects  of  what  educational  technologists 
do—even  during  the  most  supposedly  rational  of  moments, 
for  instance,  when  we're  selecting  an  instructional 
strategy.    Admitting  the  lifeworld  and  admitting  we  can't 
know  and  control  all  aspects  of  learning  are  steps  that 
might  be  well  received  because  of  their  openness  and 
honesty.    This  openness  might  lead  us  not  only  to  other, 
more  sensible  kinds  of  knowledge,  but  to  a  moral 
condition  in  which  technology  is  used  more  to  educate  and 
less  to  subjugate  people  and  the  earth. 
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One  of  the  advar.uages  m  utilizing  computers  to  facilitate 
instruction  is  the  ability  to  provide  the  student  with  immediate 
feedback  to  convey  the  correctness  or  incorrectness  of  his  or  her 
response.    If  computers  are  to  be  used  as  primary  delivery  systems  in 
educational  and  training  applications,  additional  research  is  necessary 
to  determine  which  types  of  feedback  are  important  for  student 
achievement  of  different  educational  objectives. 

There  are  numerous  kinds  of  feedback.    Feedback  cannot  be  easily 
defined  primarily  because  a  number  of  theoretical  positions  are  embedded 
in  the  concept  today  (Langer,  1983).    Results  indicate  that  all  feedback 
strategies  are  not  equally  effective  in  facilitating  student  achievement 
of  different  educational  objectives  (Dwyer  &  Arnold,  1976).  However, 
according  to  Lar.gpr  (1983),  feedback  is  considered  a  critical 
instructional  component  by  most  instructional  systems  analysts  and 
psychologists. 

Feedback  can  range  from  a  simple  knowledge  of  correct  response  such 
as  "yes,  that's  right"  or  "no,  that's  wrong"  (Travers,  Van  Wagen, 
Haygood,  i  McCormick,  196<»)  to  an  elaborate  computer-based  mechanism 
that  continuously  shows  students  what  progress  they  have  made  toward 
mastery  of  an  objective  by  providing  meaningful  advice  and  the 
appropriate  stimuli  necessary  to  obtain  it  (Tennyson  &  Buttrey,  1980). 
Kulhavy  (1977)  suggests  that  feedback  could  be  treated  as  a  unitary 
variable  ranging  along  a  continuum  from  a  simple  "Yes  -  No"  to  the 
presentation  of  substantial  corrective  or  remedial  information  that  may 
extend  the  response  content,  or  add  additional  information  to  it. 

Several  research  studies  indicate  that  the  most  effective  form  of 
feedback  is  corrective  feedback  as  opposed  to  positive  feedback. 
Feedback  has  its  greatest  effect  on  high  confidence  errors  (Kulhavy, 
Yekovich,  &  Dyer,  1976).    Guthrie  (1971)  found  that  feedback  facilitated 
learning  when  it  followed  incorrect  responses  and  had  no  effect  on 
learning  following  correct  responses. 

Gagne,  Wagner,  and  Rojas  (1981)  consider  that  feedback  is 
absolutely  essential  in  designing  computer  assisted  instruction. 
Tennyson  and  Buttrey  (1980,  p.  175)  contended,  "A  lea-ner-controlled 
condition  can  be  a  valuable  instructional  management  system,  especially 
for  computer  based  instruction,  if  students  receive  sufficient 
information  about  their  learning  development." 

The  effectiveness  'jf  covert  vs.  overt  learning  strategies  has 
produced  somewhat  mixeJ  results  in  the  literature.    This  is  partially 
due  to  the  type  of  'earning  being  investigated  and  the  methods  used  to 
produce  covert  or  overt  rehearsal.    Overt  learning  strategies  engage  the 
learner  in  some  form  of  outward  or  physical  activity  to  aid  in  he 
encoding  of  information  in  long-term  memory.    Overt  rehearsal,  by 
requiring  the  learner  to  generate  knowledge  and/or  produce  and  answer, 
makes  the  learner  aware  of  limitations  in  his  understanding  (Bransford, 
1979).    Overt  rehearsal,  therefore,  has  the  potential  to  be  an  effective 
learning  strategy  which  facilitates  retention.    Dwyer  (198<»)  discovered 
that  a  form  of  overt  rehearsal  in  which  students  shaded  portions  of  the 
human  heart  resulted  in  an  effective  rehearsal  strategy  to  facilitate 

learning.  ^  ^    ^  t. 

However,  in  non-drill  computer  lessons  requiring  a  student  to  make 
an  overt  response  by  typing  an  answer  immediately  following  feedback, 
the  student  learns  to  type  the  correct  answer  without  attending  to  the 
question  paired  with  the  answer  (Siegel  &  Misselt,  198<»). 
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Covert  rehearsal  deals  with  internalizing  or  mentally  processing 
information.    Re^«^rcners  (Bobrow  h  Bower,  1969;  Anderson,  Goldberg,  and 
Hidde,  1971:  Bra.isford,  1979;  Dwyer,  198^)  generally  found  the  covert 
activity  of  reading  correct  statements  does  not  provide  frr  a  levpl  of 
processing  activity  to  be  significant.    However,  the  ineffectiveness  of 
the  covert  activity  of  reading  correct  statements  does  not  conclude  that 
all  covert  methods  are  ineffective.    One  of  the  major  problems  involved 
in  conducting  research  on  covert  rehearsal  is  determining  the  extent  to 
which  the  learner  is  actually  performing  the  covert  rehearsal  task. 

The  utilization  of  feedback  in  computer-based  instruction  is  a 
relatively  new  ar^a  which  requires  additional  researcr.  to  further 
enhance  the  knowledge  base  in  this  area.    This  study  attempts  to  explore 
this  area  of  computer  generated  feedback  based  upon  the  knowledge  gained 
in  both  written  and  computer-based  instruction. 


One  hundred  twenty-six  freshman  and  sophomore  college  students 
participated  in  this  study.    Volunteer  participants  represented  a 
variety  of  academic  majors. 

Instructional  Materials 

The  instructional  materials  used  in  this  study  consisted  of  the 
parts  and  functions  of  the  human  heart  developed  by  Dwyer  <1965).  The 
materials  included  a  2,000  word  script  which  desr-ibed  the  parts  of  the 
heart  and  their  respective  roles  in  the  diastolic  and  systolic  phases 
and  four  posttests  (drawing,  identification,  terminology,  anc 
comprehension) . 

Programed  instructional  bocMets  developed  by  Parkhurst  (197^)  were 
used  as  a  guide  for  organizing  .he  heart  script  into  instructional 
frames.    These  frames,  including  the  associated  graphics,  became  the 
basis  for  the  development  of  an  instructional  computer  program  by  the 
author  in  Pascal  for  IBM  and  compatible  computers. 

The  program  was  self-paced  allowing  the  student  to  look  at  a  frame 
until  the  space  bar  was  pressed.    There  were  38  instructional  frames, 
i^ll  but  the  first  had  associated  questions  requiring  a  student  response 
id  providing  feedback. 

Instructional  Treatments 

There  were  three  major  instructional   ./eatment  groups  -  simple 
feedbacK,  covert  feedback,  and  overt  feedback.     Identical  instructional 
frames  consisting  of  text  and  a  labeled  ^aphic  of  the  heart  were 
presented  to  each  group.    Following  each  instructional  frame  was  a 
question  frame.    The  treatments  differed  in  the  associated  feedback 
frames  following  the  student  response  to  the  question. 

For  extt.^ple,  one  frame  had  a  short  paragraph  which  discussed  the 
concept  that  the  lower  portion  of  the  heart  is  called  the  apex  and  is 
the  part  you  feel  beating.    The  heart  graphic  had  a  label  Lox  v^ith  the 
term  APEX  inside  with  a  line  drawn  to  the  lower  porcion  of  the  heart. 
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The  associated  question  presented  after  the  instruction  was:  The 

portion  of  the  heart  th^t  you  feel  beating  is  called  the   ,  The 

student  was  then  required  to  type  a  response. 

Simple  feedback  consisted  of  the  statement  "Your  answer  is 
correct."  or  "Yout  answer  in  NOT  correct."  followed  by  the  correct 
answer  and  a  computer  graphic  of  tne  heart  with  the  correct  answer 
displayed  as  a  label.    Covert  feedback  was  the  same  as  vhe  first 
treatment  except  the  graphic  of  the  heart  had  blank  label  boxes  with 
time  delayed  labels  allowing  the  student  to  maks  a  covert  response  by 
visualizinrj  the  correct  label  in  his  or  her  mind  before  it  appeared. 
During  ovf.Tt  feedback,  students  were  required  to  make  an  overt  response 
by  entering  the  correct  answer  to  the  question  a  second  time.  The 
comp»^ter  program  would  only  accept  the  correct  answer  and  displayed  it 
letter  by  letter  in  the  proper  position  on  the  graphic  as  it  was  typed. 

Dependent  Measures 

Dependpn.-  measures  were  the  scores  on  !?ach  of  the  four  post  tests. 
The  objective  of  the  drawing  test  was  to  evaluate  the  student  ability  to 
construct  and/or  reproduce  items  in  their  appropriate  context.  The 
identification  test  evaluated  student  ability  to  identify  parts  or 
positions  of       object.    It  consisted  of  CO  multiple  choice  items.  The 
terminology  test  a^so  consisted  of  20  multiple  choice  items  and  was 
designed  to  measure  the  student's  knowledge  of  specific  facts,  terms, 
and  definitions.     In  the  20-item  comprehension  test,  the  student  was 
given  the  location  of  certain  parts  of  the  heart  at  a  particular  moment 
of  its  functioning,  then  ask  to  locate  xhe  position  of  other  specified 
parts  of  the  heart  at  the  same  point  of  time. 

Procedure 

The  126  participants  were  randomly  assigned  to  one  of  the  three 
treatment  groups  with  a  group  size  of  ^f2.    Each  participant  was 
individually  given  brief  instruction  on  the  physical  operation  of  the 
computer  and  the  instructional  program.    Participants  then  proceeded 
through  the  instructional  unit  at  their  own  pace.    The  tests  were 
administered  to  the  students  as  they  completed  the  unit.  Subjects 
completed  and  returned  the  drawing  test  before  receiving  the 
identif iration,  terminology,  and  comprehension  tests. 

Data  Analvsis 

A  one-factor  ANOVA  was  u'ied  to  analyze  scores  for  each  of  the  ^ 
tests.    A  total  composite  test  score  con£»isting  of  the  accumulated 
scores  of  the  identification,  terff>^ nology ,  and  comprehension  tPsts  was 
also  analyzed. 

For  all  statistical  analyses  and  follow-up  tests,  alpha  was  set  at 
the  .05  level.     If  a  significant  F-ratio  wa<;  found  for  th*^  feedback 
method,  the  means  were  tested  using  the  Tukey  Wholly  Significant 
Difference  Test. 
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RESULTS 


Table  1  contains  the  means  and  standard  deviations  for  three 
feedback  groups  for  each  of  the  tests.    Significant  differences  '^ere 
found  for  3  of  the  ^  tests  and  for  the  total  test  scores.  No 
significant  differences  were  found  for  the  identification  test. 

Significant  differences  were  found  for  the  terminology  test  with 
F(2,123)  «  3.6^,  p  <  .05.    The  comprehension  test  scores  were 
significant  with  F(2,123)  -  ^.81,  p  =  .01.    The  composite  total  test 
scores  were  also  significantly  different  with  F(2,1S3)  -  ^.53^  p  =  .01. 
The  greiitest  significant  differences  were  found  for  the  drawing  test 
with  F(2,123)  «  13. h3,  p  <  .001. 

The  follow'up  tests  indicated  the  covert  feedback  scores  were 
significantly  higher  in  every  test.    Vhe  simple  and  overt  groups  were 
found  to  produce  equivalent  results  in  thn  terminology  and  comprehension 
tests  and  fcr  the  total  test  scores.    However,  the  covert  and  overt 
group  scorefi  were  similar  for  the  drawing  test  and  better  than  the 
simple  feedback  group.    In  summary ,  the  scores  were  generally  the 
greatest  for  the  covert  method  and  thi^  least  for  the  simple  feedback 
method  with  the  overt  method  equivalent  to  the  simple  method  is  most 
cases. 


TABLE  1 


Mean  Scores  and 

Standard 

Deviations 

on  Posttests 

FEEDBACK  GROUP 

TEST 

Simple 

Covert 

Overt 

Totals 

Identification 

Mean 

1^.7 

16.1 

1^.9 

15.2 

(N  =  ^2) 

SD 

3.3 

3  0 

3.5 

3.3 

Terminology 

Mean 

11.6 

13.6 

11.5 

12.2 

(N  s  ^2) 

SO 

^.2 

^.0 

3.9 

^.0 

Comprehension 

Mean 

11.7 

H.3 

12.3 

12.8 

(N  -  ^2) 

SD 

^.2 

3.7 

3.9 

3.9 

Total (I+T+C) 

Mean 

38.0 

38.8 

^0.3 

(N  =  ^2) 

SD 

10.5 

9.2 

10.0 

9.9 

Drawing 

Mean 

1C.6 

17.0 

15.5 

15.0 

(N  «  ^2) 

SD 

^.5 

3.^ 

3.8 

3.9 
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DISCUSSION 


The  various  typ-'S  of  feedback  had  different  effects  on  the 
objectives  measured  by  the  pos.tesls  ranging  from  the  identification 
test  which  required  a  minimal  level  of  learning  factual  information  to 
the  comprehension  test  that  required  th^  students  to  have  a  thorough 
understanding  of  the  heart,  its  parts,  its  internal  functions,  and  the 
simultaneous  processes  occurring  during  its  phases.    The  various 
feedback  strategies  also  had  a  significant  effect  on  the  draw-.ig  test 
which  evaluated  the  student's  ability  to  construct  and  reproduce  items 
in  their  appropriate  context. 

The  covert  strategy  in  which  subjects  viewed  unlabeled  boxes  and 
att^-'^pted  to  mentally  fill  in  the  labels  before  the  actual  labels 
appeared  after  a  time  delay,  proved  to  be  the  most  significant  method  in 
this  study.    Past  researchers  (Bobrow  and  Bower,  1969;  Anderson, 
Goldberg,  and  Hidde,  1971;  Bransford,  1979;  Dwyer,  198^)  generally  found 
that  covert  rehearsal  strater^es  do  not  provide  a  level  of  processing 
activity  to  be  significant.     Their  failure  to  find  significant  effects 
may  have  resulted  from  the  level  of  covert  activity  being  utilized  such 
as  reading  statements. 

The  covert  activity  in  this  study  differed  because  the  computer 
focused  the  subjects  attention  on  the  screen  by  using  an  unlabeled  box 
as  a  cueing  technique  and  at  the  same  time  challenged  the  student  to 
visualize  the  correct  answer  before  it  appeared.    This  additional 
motivational  aspect  apparently  produced  a  level  of  internal  processing 
allowing  for  significant  encoding  of  information  into  long-term  memory. 
Another  explanation  for  the  success  of  the  covert  strategy  and  the 
contradiction  to  previous  research  was  that  it  wa?  incorrectly  named 
covert  when  in  fact  it  was  an  overt  strategy.    It  was  highly  structured 
and  engaged  thp  <»«hject5  in  an  intense  form  of  mental  interaction.  In 
factj  the  invr  or  observed  outward  physical  signs  when  subjects 

recalled  the  c      .wt  label  in  the  blank  box  or  failed  to  mentally  fill 
in  the  label  before  the  time  expired  and  the  label  appeared     A  truly 
covert  activity  such  as  reading  summary  statements  would  not  elicit  a 
physical  response.    The  previous  research  involving  covert  rehearsal  was 
based  on  a  lesser  level  of  mental  activity.    If  the  covert  method  is 
renamed  as  another  overt  strategy,  its  strengths  would  be  supported  by 
prior  studies  which  actively  engaged  the  learner  in  a  rehearsal 
activity. 

The  overt  strategy  was  less  effective  than  the  covert  strategy  when 
compared  to  the  simple  feedback  method.    The  overt  strategy  required  the 
student  to  correctly  type  the  answer  to  the  frame  question  a  second  time 
while  it  was  displayed  in  the  appropriate  position  on  the  graphic  of  the 
heart.    Although  overt  methods  have  generally  been  more  effective  than 
covert  methods  is  previous  research.    The  result  of  this  particular 
strategy  supports  Siegel  and  Mis^elt  (198^)  who  stated  in  non-drill 
computer  lessons  requirinq  a  student  to  make  and  overt  response  by 
typing  an  answer  immediately  following  feedback,  the  student  learns  to 
type  the  correct  arswer  without  attending  to  the  question  paired  with 
the  answer.    Typing  is  a  motor  skill  that  does  not  always  require 
concentration  on  the  item  b^lng  typed. 
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The  overt  strategy  was  superior  to  simple  feedback  but  not 
significantly  different  from  the  covert  strategy  in  the  drawing  test. 
This  may  have  resulted  because  subjects  were  using  visual  images  of  the 
screen  to  reproduce  the  heart  and  locate  its  components.    This  activity 
was  independent  of  utilizing  feedback  to  reinforce  or  correct  answers  to 
the  question  that  were  needed  to  do  well  in  the  other  tests.  Both 
covert  and  overt  methods  were  comprised  of  more  elaborate  feedback 
screens  to  enhance  this  internal  visual  model.    This  could  indicate  a 
dual-coding  (Paivio,  1971)  in  which  the  visual  information  was  more 
effectively  coded  than  the  corresponding  verbal  information  associated 
with  the  frame  question. 

These  results  emphasize  the  importance  of  this  type  of  research  for 
the  instructional  designer  who  might  otherwise  conclude  the  repetitive 
typing  of  correct  answers  during  non~drill  lessons  would  automatically 
insure  increased  learning  of  the  content  material.    Another  .':;ajor 
finding  of  this  study  emphasizes  that  all  methods  of  computer  ger  rated 
feedback  are  not  equally  effective  in  facilitating  student  achievement 
of  different  educational  objectives.    However,  if  properly  designed, 
computer-generated  feedback  has  the  potential  of  being  very  effective. 
In  practical  terms,  the  instrucViOnal  designer  could  gain  from  the 
findings  of  this  study  and  design  computer-based  instructional  software 
incorporating  the  idea  of  time  delayed  labels.    This  method  could  be 
also  applied  to  primary  instruction. 

A  final  point  of  discussion  deals  with  whether  or  not  methods  used 
in  this  study  were  actually  feedback.    Using  a  strict  definition  of 
feedback  as  information  on  the  correctness  of  a  response,  they  were  not. 
However,  Kulhavy  (1977)  suggested  that  feedback  could  be  treated  as  a 
variable  ranging  along  a  continuum  from  a  simple  "Yes  -  No"  to  the 
presentation  of  substantial  corrective  or  remedial  information  that  may 
extend  the  response  content,  or  add  additional  information  to  it.  This 
study  used  more  elaborate  methods  that  prompted  students  to  attend  to 
the  feedback.    There  is  a  need  for  further  research  involving  new 
methods  to  make  computr^r-generated  feedback  more  effective  for  the 
learner. 
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Animation  Review  2 
A  Review  of  Animation  Research  in  Computer-Based  Instruction 


Abstract 


Although  the  use  of  animated  visuals  is  both  common  and  popular  among  CBI  desieners  the 

2S^^n?l  ^"""^ established.  Animated  visuals 

represent  a  subset  of  mstrucnonal  visuals,  not  a  distinctive  set.  For  this  reason,  general  condusSns 
from  research  on  static  visuals  are  thought  to  extend  to  animated  visuals.  How^vct.  tfSe«ent  to 
"^'"^  '^P^*"*  elaborations  or  departure  from  this  researx;h  is  qktioncd.  The 
purpose  of  this  paper  is  to  review  current  empirical  evidence  of  the  instructional  effectiveness  of 
animated  vusuals  as  an  adjunct  or  alternate  presentation  strategy.  Current  applications  of  cotiduW 

"jnstruction  are  discussed  and  a  taxonomy  to  aid  ^^prescriptive      SSv?Ses  is 
suggested.  The  theoretical  foundations  of  animated  visuals  in  the  areas  of  perception  and  loiSS 
memory  are  also  discussed  and  a  brief  summary  of  static  visuals  research  Is^s^^fS 
conclusions  and  prescriptions  resulting  from  this  review  are  presented       P^*"""-  *^"^'y' 


Introduction 


Animation  is  an  uicreasingly  popular  element  in  computer-based  instruction  (CBD  and  its  use 
^^SJ'i^.?^       of  graphics,  is  often  advocated  (Bork.  1981;  CaldweU.  1980).  EvinTcSu^' 
^^'^Ll^*f       commercial  educational  software  packages  available  today  demonstrates  the 
iT^J^^^^^         "^^"^  Unfortunately,  animation  is  often  incorporated 

into  a  program  with  the  mtent  to  impress  rather  than  instruct  the  user.  Sound  and  graphics  have 
always  been  among  the  most  seductive  educational  aspects  of  computer  technologThcreased 

^^-^^^^^^'^^^^  *e  -glitter-  ofLZZ^^Sl^^n 

in,m.rri!Il??'S?!^       ^°  fundaraintal  approaches  to  designing  and  evaluating  computer-based 
uismiction  (CBI)  -  technocentnc  design  and  instructional  design.  Technocentric  design  is 
t^^^;^^^     is.cva^uated  based  on  how  v..U  the  capaWlities  of  the  hardwaS^  S;  utilized, 
SfSf r,?;^'''*?**.?*'''^."  J.'-  ^^^^^^  ^^''-d  J^ics  to  incorporate  sound  instrucriSSes 
fXw  h".?^     P'P"         ? ^'Sn  and  evaluation  of  animated  visuals  shS  ^ 

eSv!L«^J        ^"'i!?  Pf^I^t^iT*-  Unfortunately,  many  educators  continue  to  evaluate  th, 
SLTf^  T^^"^        °?  technocentric  design  principles.  This  may  be  because  the 
S^^iKf  are  stiU  functioning  at  the  "familiarization"  level  of  computer  technolo^  (Rieber 

Although  inappropriate  instnictional  applications  of  animation  are  frequ(,ndy  caused  bv 
technocenoic  attitiides.  htde  guidance  has  been  provided  to  designers  and  cSsum^  bylWhers 
and  reviewers.  Although  much  research  has  been  done  to  estabUsh  die  conTxtswSne  sSi^^s 

'^'f'''-  has  S?n  condS  to  S,v«ti^te 

^T^^-^^f  ?  anmiation  directly  or  to  systematically  study  what  potential  differences  benvwn 
stodc  and  animated  visuals  exist  AdditionaUy.  the  empirical  dato  prese!Sy  available  reSSinT 
animated  mstruction  has  been  inconsistent  A  premise  of  this  papw  is  that  animated  (or  dynarSic) 
visuals  represent  a  subset  of  instructional  visuals,  not  a  distincti^Tset  Hence^U  iTeS^SlX 
gmdehaes  generat«i  from  die  large  body  of  research  on  static  visuals  extend  to  anSd  ^uak  but 
do  not  necessanly  fiiUy  account  for  differential  effects,  if  any. 

fiinrti  Ji.'^fl^**^  applications  of  animation  serve  one  or  more  of  the  foUowinr  six 

SSiioi  Attention-gaining;  3)  Motivation/Reinforcement;  4)  Conceptuali^tion;  5) 

!S?S?n  •        Interactive  dynamics.  These  six  functions  represent  an  initial  atteV  at 
estabhshing  a  taxonomy  of  the  uses  of  animated  visuals  in  instruction.  It  should  be  notSat  die  onset 
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that  this  is  not  meant  to  be  a  media  comparison  review.  The  conclusions  and  prescripticms  are 
directed  toward  animation,  a  media  attribute,  and  not  toward  the  computer  medium  direcdy,  although 
the  cwitentiwi  is  made  that  few  otfier  media  possess  the  inherent  capabilities  to  deliver  animated 
instruction  across  the  taxonomy  as  does  the  computer.  This  is  consistent  with  the  contentions  and 
arguments  presented  by  Clark  (1983)  and  others  (Solomon  &  Qa^c,  1977;  Solomon  &  Gardner, 
1986)  that  instruk  ^onal  design,  not  media,  accounts  for  differentiated  learning  effects.  This 
discussion  is  but  u  first  step  in  determining  if  animation  represents  a  sufficient  (though  perhaps  not 
necessary)  craidition  for  learning  when  die  learning  task  is  congruent  to  the  attributes  of  animation. 

The  purpose  of  this  paper  is  to  review  current  research  investigating  the  effectiveness  of 
anmmtim  as  a  presentation  (adjunct  or  alternate)  strategy.  Preceding  this  review  will  be  a  description 
of  the  taxmcxny.  Also,  the  tiieoretical  framewwk  underlying  the  potential  effects  of  animati<Mi, 
^ifically  in  the  areas  of  perception  and  long-term  memory  retention  and  retrieval,  will  be  briefly 
discussed.  Additionally,  the  research  and  subsequent  conclusions  of  '^atic  visual  research  will  be 
reviewed.  Since  these  related  research  areas  are  based  on  the  same     jretica'  framewwk,  they 
present  a  reasonable  empirical  substitute  ftom  which  to  draw  tentative  guidehnes  in  the  design  of 
animated  instruction. 


A  Taxonomy  of  Animated  Visuals  in  CBI 

In  a  recent  review  of  instructional  pictures,  Levie  (1987)  suggested  that  motivation  and 
learmng  are  the  primaiy  motives  to  incorporating  instructional  visuals.  In  order  to  help  CBI  designers 
uitegrate  animatiwi  effectively,  more  detailed  elaborations  of  these  motives  are  needed.  For  this 
reason  a  six  category  taxonomy  is  presented  to  help  classify  the  uses  cf  animation  in  CBI:  1) 
QMmetic;  2)  Attention-gaining;  3)  Motivation/Reinforcenoent;  4)  Conceptualization;  5)  Presentation; 
and  6)  Interactive  dynamics.  This  taxonomy  serves  to  clarify  the  instructional  (prescriptive  and 
evaluative)  purposes  of  animation.  It  is  possible,  and  likely,  that  the  instructional  intent  and  result  of 
my  one  animated  visual  could  be  classified  across  more  than  one  category.  It  is  also  very  likely  that 
Ae  iiistructional  intent  can  be  entirely  different  fiom  the  instructional  result  whtn  designers  make 
decisions  to  include  animated  visuals  based  on  misinformation,  misinterpreted  infatmation.  or  no 
information. 


Cosmetic 

This  is  the  only  category  which  has  no  direct  instructional  intent  The  purpose  of  animation  is 
merely  to  make  the  program  more  attractive.  Examples  include  special  effects  during  opening  tides  or 
screens  and  are  often  used  to  advertise  the  product's  or  publisher's  name.  It  is  possible  for  cosmetic 
us«  of  aramation  to  also  perform  an  attention-gaining  function  by  presenting  an  interesting  graphic 
in-between  lesson  parts  to  pique  attention.  However,  there  arc  several  dangers  to  using  animation  for 
only  cosmetic  reasons.  The  learner  may  not  perceive  the  animation  as  merely  adding  to  the  "decor"  of 
the  program,  but  may  perceive  I'  as  tiiere  for  an  instructional  purpose.  This  not  only  detracts  the 
learner  s  attention  for  an  urelevant  task,  but  also  risks  frustrating  the  student  when  no  instructional 
link  IS  found,  or  worse  misleads  the  student  in  some  way.  Issues  in  cosmetic  uses  of  computer 
graphics  appear  sunilar  to  both  static  and  animated  graphics. 

Atte^irinn-yflininy 

^ust  as  with  stadc  graphics,  attention-gaining  is  an  obvious,  practical,  and  rationale  use  of 
ammaacn.  Attention-gaining  is  an  important  initial  event  of  t  struction  (Gagn6, 1985).  Animation 
can  be  an  eifective  way  of  arousing  and  maintaining  a  learner's  attention  during  CBI.  Examples 
uiclude  interestmg  special  effects  for  transitions  between  instructional  fiames  or  lesson  parts  Special 
screen  washes,  moving  symbols  or  characters  (cartoon  or  text),  animated  prompts,  such  -s  arrows 
which  direct  attention  to  key  words,  paragraphs,  graphics,  or  other  screen  items  arc  still  other 
examples  of  anuiated  attention-gaining  devices.  Anunated  figures  offer  contrast  to  a  static 
background,  thus  bringing  the  animated  figure  to  prominence,  thus  amplifying  or  emphasizing 
important  lesson  information  (Hannafin  &  Peck,  1988). 
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Morivarion/Reinfnrcftnvnt 

MotivarionaiappUcationsofaniimtionhaveb^^ 
haphazardly,  in  CBI  design.  In  this  context,  animation  acts  as  reinforcement  or  feedback  to  student 
responses.  Much  of  the  motivating  appeal  of  animated  visuals  is  due  to  novelty.  Unfortunately, 
novelty  effects,  though  real,  are  temporary  and  graduaUy  disappear  over  time  (Qaric.  1983) 
Apphcation  of  static  or  animated  visuals  to  reinforce  student  answers  must  be  made  cautiously 
Attractive  and  interesting  graphics  which  occur  when  a  student  answers  incorrectly  may  actually 
reinforee  wrong  responses.  For  example,  an  instructional  program  on  weights  and  measures 
available  finom  the  Minnesota  Educational  Computer  Corporation  (MECC)  illustrates,  through 
animation,  a  gallon  pitcher  filling  a  number  of  quart  pitchers.  If  the  student  responds  that  tluce  quarts 
equal  one  gallon,  tfien  die  final  quart  is  spiUed  onto  the  floor.  If  watching  milk  being  spiUed  onto  the 
floor  IS  more  mterestmg  to  the  student,  then  only  an  incorrect  response  wiU  eUcit  this  reinforcement, 
me  power  of  computer  graphics  as  a  long-term  motivational  tooi  designed  to  increase  student 
perserverance  does  not  have  much  empirical  support  (Surber  &  Leeder.  1988). 

Presentation 

Using  anirnated  graphics  as  an  adjunct  or  alternate  presentation  strategy  represents  the  most 
direct  instructional  application  of  animation.  This  area  represents  the  main  body  of  reported  research 
discussed  later.  Animation  is  used  in  two  principal  ways.  First,  it  provides  an  alternative  or 
supplement  to  text  in  defining  a  concept,  rule,  or  procedure.  Second,  it  provides  an  alternative  or 
supplement  to  text  in  providing  examples,  nonexamples.  or  elaborations  of  a  concept,  rule,  or 
procedure.  The  apparent  processing  parmership  between  appropriate  use  of  visual  (eg.  static  or 
ammate.1 ^phics)  and  verbal  (textual)  infomiation  is  the  foundation  of  several  theories  of  lone-term 
inemory  ^ower,  1972;  Paivio,  1979)  and  is  discussed  in  more  detaU  lat^.^eSoSsS)  dc^lS^ 
this  use  of  imimated  graplucs  as  a  "Icaming-by-viewing  approach"  (p.  297-298).  An  example  of  this 
HSJlIt     »!P^  ammation  is  depicted  in  Figure  1.  Static  or  animated  graphics  uSed  in  this 

manner  can  be  classified  as  representational,  analogical,  or  arbitrary  (Alesandrini  1984) 
Rq)iescntational  ^phics  aic  those  that  share  a  physical  resemblance  with  the  thiilg  or  c<incept  that 
UK  pict«ire  stands  for.  Analogical  graphics  represent  a  concept  or  topic  by  showing  something  else 
and  implying  a  smnlanty  and  the  learner  >.r.uf,t  be  able  to  recognize  the  analogy  Ariritrary  graphics  do 
not  look  hke  tfie  things  tiiey  represent,  but  arc  related  in  logical  ways.  ArbitSy  pictures  indude 
graphs,  flowcharts,  maps,  and  tree  diagrams.  Most  of  the  empirical  evidence  discussed  later  involves 
representational  ammated  graphics.  mvuivw* 


Insert  Figure  1  About  Here 


Concephialiyarion 

This  category  defines  an  appUcation  of  animation  which  is  closely  related  to  presentation 
Here,  animation  IS  used  to  aid  a  student's  conceptual  understanding  without  providing  any  new 
information  to  Ac  stu(tenL  This  application  does  not  replace  or  supplement  definitions,  examples, 
and/or  nonexamples  of  concepts,  rules,  or  procedures,  but  rather  clarifies  relationships  through  visual 
means.  A  good  of  example  of  this  is  die  software  program.  The  Factory  (Kosel  &  Fish,  1983) 
which  IS  represented  in  Figure  2.  In  it  students  attempt  to  create  or  repUcate  a  product.  The  produc* 
starts  out  ui  raw  matenal  form  as  a  square  wafer.  The  raw  material  is  sent  through  any  number  of  ' 
amibuiations  of  punch,  stripe,  and  rotation  "machines"  which  successively  alter  the  product  into  its 
final  shape.  By  anrniating  die  product  through  the  factory,  students  see  die  factory  assembly  process 
executed  as  diey  designed  it.  The  program's  animation  does  not  contribute  to  die  student's 
knowledp  base,  but  ratfier  provides  a  concrete  representation  of  die  process  which  involves  a 
potentially  complex  array  of  relationships  among  individual  cOTiponents 
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Insert  Figure  2  About  Here 


Aimnation  has  a  indirect  relationship  to  the  learning  tzsk  when  applied  in  this  way.  Its  effect 
is  very  dependent  on  the  learner's  prior  knowledge  of  the  learning  task.  Novices,  who  probably 
would  have  difficulty  in  seeing  abstract  relationships  on  their  own,  would  be  expected  to  benefit  frcm 
animation  when  used  in  this  context 

Interactive  Dynamics 

Interactive  dynamics  represent  an  instructional  application  of  animation  where  the  mle  of 
animation  is  vital,  but  difficult  to  distinguish.  In  this  context,  computer  animation  permits  the  design 
of  interactive  programs  in  which  students  leam  by  discovery  and  informal  hypothesis-testing.  The 
graphics  change  continuously  over  time  depending  on  student  input,  thus  acting  as  a  form  of 
instantaneous  graphic  feedback.  This  application  of  animation  is  what  Biown  (1983)  called 
"leaming-by-doing".  Successful  examples  include  simulations,  such  as  piloting  an  airplane  or 
interacting  with  a  Newtonian  particle  in  a  gravity-fiec/fiictionless  environment  as  shown  in  Figure  3 
(diSessa,  1982;  White,  1984),  and  learning  musical  concepts  (Lamb,  1982).  Other  examples  include 
gr^hic  programming  pix>cedurcs  in  LOGO  where  students  drive  an  animated  "turtle"  on  the  screen 
(Papert,  1980).  However,  it  is  important  that  students  be  able  to  perceive  differences  in  the  graphic 
V^^^    ^^^^  "^^^^  novices  especially  have  a  difficult  time  attaining  (Brown,  1983;  Cohen, 
1988;  White,  1984).  Several  have  indicated  the  need  to  structure  the  interactive  dynamic  in  various 
ways  to  offset  this  deficiency  (White,  1984;  Rieber,  1988)  or  to  augment  such  interactions  with 
coaching  or  other  pnxnpis  (Reed,  1985).  Interactive  dynamics  represent  a  use  of  animation  not  easily 
repucated  given  media  other  than  the  computer. 


Insert  Figure  3  About  Here 


A  Theoretical  Framework 

Several  theoretical  fiameworks  exist  to  support  the  contention  that  animation  should  be 
effective.  This  section  describes  two  theoretical  perspectives.  First,  several  perceptual  factors  are 
briefly  described  which  help  to  explain  how  the  illusion  of  animation  is  made  possible.  Second,  and 
rnoru  importantly,  are  current  views  on  how  visuals  contribute  to  long-term  retention  of  teamed 
information. 

Perceptual  Factors 

Perception  is  the  p  icess  which  involves  selectively  attending  to  and  scanning  a  given 
stimulus,  interpreting  isignificant  details  or  cues,  and  finally  perceiving  some  gencTiil  meaning  (Levie, 
1^87).  Visual  cognition  is  tiie  process  of  how  people  perceive  and  remember  visual  information 
(Pinker,  1984).  Having  students  perceive  meaning  fmm  animated  visuals  relies  on  tricking  them  to 
see  sometiiing  that  really  is  not  there.  Certain  basic  perceptual  factors  help  to  explain  this 
phenomenon. 

ComputtT  animation  can  be  defined  '^s  a  series  of  rapidly  changing  computer  screen  displays 
that  present  the  illusion  of  movement  (A.  Caraballo,  1985).  Animation,  whether  on  computer,  film, 
or  otherwise,  is  not  real  motion,  but  only  a  representation  of  motion.  Even  the  moSi  sophisticated 
computer  graphics  systems  operate  on  a  "draw,  erase,  change  position,  draw"  repetition  to  produce 
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animation.  When  individual,  non-moving  images  are  shown  collectively  at  around  16  frames  per 
second  the  motion  is  perceived  as  smooth  and  continous.  This  is  known  as  stroboscopic 
motion,  mien  images  are  she  i  at  a  rate  of  less  than  16  frames  per  second,  the  motion  appiars 
choppy  or  lumpy.  Even  the  most  inexpensive  computer  systems  available  today  easily  match  this 
pciceptual  requirement  for  adequate  illusions  of  roovcnwnt.  Jnteiestingly,  a  commeir-iolly  avaUable 
electronic  child  s  toy  called  "Th.*  Animator"  operates  at  far  bss  than  the  16  frames  per  second  level, 
but  seems  to  readily  elicit  the  movement  illusion  in  children.) 

Related  to  stroboscopic  motion,  is  the  phi  phenomenon,  which  is  the  illusion  proouced 
when  staaonary  lights  arc  turned  on  and  off  in  such  a  manner  that  a  moving  image  appear,. 
Exanoi^es  oi  this  phenomenon  include  theater  marquee  lights,  Las  Vegas  casino  lights,  and 
scoreboards  in  spons  arenas.  TTie  phi  phenomenon  also  accounts  for  animation  produced  by  the 
coordmation  of  computer  graphic  pixels. 

Both  s^boscq)ic  motion  and  the  phi  phenomenon  seem  to  occur  because  of  the  Gestalt  law 
of  oontmuity  (Rath'js,  1987).  We  tend  to  perceive  a  series  of  points  as  having  unity,  and  so  a  series 
ot  lights  IS  perceived  as  a  moving  object  Motion  perception  is  a  part  of  each  individual's  schema,  or 
orgmuzea  network  of  worW  knowledge  (Norman,  1982),  because  we  Uvc  in  a  dynamic  woiid  where 
v«y  little  visual  infonnation  is  truly  static  (Goldstein,  Chance,  Hdsington,  &  Buescher,  1982). 
Therefore,  mstruction  can  easUy  prompt  an  individual  to  expect  nnotion.  Consequently,  through 
top-down  mental  processmg,  the  individual  then  "sees"  moticn  in  a  ooUection  of  carefiiUy  coordinated 
static  lights  m  order  to  fulfill  the  expectation.  ' 

Long-term  memnrv  stnirtiinffs 

Hunaans  appear  to  be  partfcularly  adept  visual  leameis  fKobayashi,  1986).  The  pitdommant 
ttwoixr-tical  explanauon  for  this  is  die  dual-coding  theory  advanced  primarily  by  Paivio  (1979, 1986) 
This  theory  suggests  that  there  are  independent  encoding  mechanisms,  one  visual  ar^  one  vei  jaL 
Alfliough  competmg  hypotheses  exist,  such  as  those  suggesting  that  all  information  (visual  and 
verbal)  is  stored  m  propositional  fonns  (Pylyshyn,  1981),  the  dual-coding  tiieory  has  considerable 
empirical  support.  Altiiough  we  may  never  fiiUy  know  die  physiological  mechanism  for  visual 
nrienory  storage,  the  dual-coding  hypothesis  probably  presents  the  most  useful  model  for  describing 
and  prescninng  visual  effects  common  in  instruction  (Anderson,  1978). 

Pai/io  s  (1979, 1986)  dual-coding  theory  contends  that  pictures  and  words  activate 
independent  imaginal  and  verbal  codes.  Based  on  this  theory,  the  superiorit>'  of  pictures  over  words 
rests  on  several  key  assumptions.  The  first  a.ssumption  r  that  separate  coding  mechanisms  have 
additi/c  effccte,  that  is,  if  something  is  coded  in  both  picture  and  vertial  fonns,  it  is  more  likely  to  be 
remembered  Aan  if  only  coded  in  one  form  (Kobayashi,  1986   The  second  assumption  is  that  the 
availabJhty  of  these  two  coding  mechanisms  differ  in  that  a  picture  is  more  likely  to  br  coded  verbally 
and  pc^OTially  than  words  (Hannafin,  1983).  Pictures  are  often  remembered  better  Aan  words 
be-v-ause  the>-  are  more  likely  to  be  encoded  rrdunt'andy  than  words.  TTius,  better  recaU  can  be 
expected  due  to  the  availabiliiy  of  two  mental  representations  instead  of  just  one.  If  one  memory  trace 
IS  lost  (whether  visual  or  veroal),  die  odicr  is  still  available. 

/I  n-iax  P"^1»<'*"8   more  likely  to  occur  when  the  contem  is  highly  imageable.  Paivio  and  Csapo 
(1973)  mvcstipteG  the  relative  contributions  oi'  imaginal  and  vertwl  memory  codes.  Their  results 
indicated  that  higher  recall  was  produc&  i  for  pictures  than  for  woids  un<»er  all  conditions  except  when 
subjects  imaged  to  words.  Most  of     supportive  research  shows  tiiat  words,  sentences,  and 
parapiphs  diat  are  highly  imageabl'  .e  recalled  better  than  tiiose  which  are  not  highly  imageable. 
The  ie»Tmng  of  concrete  concepts  pre.»des  die  learning  of  abstract  concepts;  concrete  concepts  are 
stored  as  images  whersas  abstract  concepts  are  stored  as  verbal  representations. 

Animation,  like  any  graphic,  should  be  expected  to  aid  die  recall  of  vcibal  inft^nnation  'vhon  it 
x^cs  to  precisely  dlustratc  a  highly  imageable  fact,  concept,  or  principle.  Piedictini  nine 
differences  based  on  using  animated  graphics  versus  static  graphics  Is  not  as  clear.  Ai..mated 
pnh'  -s  shou'^  provide  greater  elaboration  dian  static  graphics  when  lesson  infonnation  involves 
hig'Jy  imageable  facts,  concepts,  or  principles  that  change  over  time.  Hence,  animation's  attributes 
of  motoon  and  trajectory  are  distinguishable  from  die  attributes  available  from  static  visuals  in  ai.%e 
mental  storage  anu  retneva!  (Klein,  1987)  in  certain  contexts.  Physics  h  stniction,  such  as  diat 
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involving  Newtonian  mechanics,  is  a  good  example  of  highly  imageable  lesson  content  that  can  be 
facihtated  by  graphics  displayed  over  a  time  continuum  The  presentation  of  animated  exrimples 
demonstrating  a  baU  being  thrown  can  be  stored  visually  as  a  concrete  example.  The  rules  that  govern 
these  forces  as  well  as  the  application  of  these  rules  can  then  be  stored  in  verbal  representations.  The 
animated  exanq>les  allow  a  more  precise  ima^  to  be  stored  as  compared  to  a  static  graphic  using 
arrows  and  dotted  lines  representing  the  concqits  ci  movemait  and  trajectory. 

Static  Visuals  and  Leaming 

Different  reviews  of  represoitational  pictures  in  instructi«i  report  conflicting  conclusions 
(^e^anMni,  1984;  Levie  &  Untz.  1982;  F»ressley,  1977;  Samuels,  1970).  Researchers  studying  the 
effects  of  pictures  ui  prose  learning  prior  to  1970  concluded  that  pictures  generally  did  not  aid  in 
V^inJlX^^'^^^^      occasionaUy  distracted  nom  the  printed  text  (Braun,  1969;  Samuels, 
1967,  IP^O).  TThe  distracting  effect  of  picture^  was  explained  by  the  principle  of  lea? t  effort 
(Underwood,  1963).  Acconhng  to  this  principle,  when  two  stimuli  a-c  presented,  the  one  which  can 
more  easily  ehcit  the  correct  response  is  attended.  Willows  (1978)  reported  a  more  recent  example  of 
the  distt«:tmg  effect  of  pictures.  Younger,  less  skiUed  readers  were  found  to  be  more  suspectible  to 
this  interference  effect  This  research  seems  to  indicate  that  a  Hne  li  ne  often  exists  between  the 
learning  and  distracting  effects  of  visuals. 

Research  conducted  since  1970,  however,  points  to  the  positive  effect  of  pictures  in  prose 
learning  sugptmg  that  pictures  can  exert  strong  positive  influences  on  leaming  given  certain 
condidons.  For  example,  evidence  suggests  that  children's  dependence  on  pictures  decreases  with 
age.  As  children  growolder  they  become  better  able  to  produce  dieir  own  internal  images  (Guttmann, 
Lcvm,  &  Pressley,  1977;  Pressley,  1977).  This  evidence  suggests  the  developmental  importance  of 
uuagery  abmty.  Imager/,  Jke  many  other  cognitive  processes,  develops  over  time  (Usgold,  Levin, 
Shimron,  &  Gvttman,  1975;  Shimron,  1975).  Related  research  has  demonstrated  the  usefulness  of 

i'^rlL"^^*?,!??!*^®*  *°  as  a  leaming  aid  (Lesgold,  McCormicI:,  &  Golinkoff, 

1975;  Pressley,  1976), 

A  review  by  Levin  and  Usgold  (1 978)  reviewed  "abundant  ec  pirical  evidence  to  document 
the  iwsmvc  vduc  of  pictures"  (p.  233).  The  most  important  conclusion  of  their  review  is  that  pictures 
should  be  highly  relate  J  or  congruent  to  the  textual  material;  unrelated  pictures  or  too  complex 
pictures  are  superfluous  and  may  be  distractiPg.  Others  have  offered  similar  design  guidelines  based 
on  the  cpn^dons  undw  which  visuals  exert  positive  effects  (see  for  example,  t!ie  "ten  commands  of 
picture  facilitation"  offered  by  Levin,  Anglin,  &  Carney,  1 987). 

Dwycr  (1978)  reviewed  over  100  studies  investigating  the  use  of  supplemental  pictures  as  an 
adjunct  Icammg  aid  ui  expository  text.  The  studies  investigated  the  effects  of  reaUstic  pictures  that 
vaned  in  the  amount  of  detail  from  highly  detailed  color  photos  to  simple  line  drawings.  The  results 
suggest  that  pictures  facihtate  leaming  for  adults  under  certain  conditions.  Sufficient  prccsssing  time 
is  necessary  when  usuig  visuals  with  realistic  details.  Richly  detailed  visuals  require  the  learner  to 
attend  to  iuid  systematicaUy  scan  the  visual  in  search  of  essential  leaming  cues.  If  insufficient  time  is 
gryen,  students  naay  actually  choose  to  ignore  the  visuals  and  attend  to  the  more  familiar,  printed  text, 
in  actore,  when  lessons  are  extemaUy  paced,  the  most  effective  visuals  contain  relatively  small 
amounts  of  visual  detail. 

The  apparent  cwitradictions  concerning  the  effectiveness  of  pictures  in  reading  require 
COTdOTS  mterpr«ation.  One  explanadon  for  why  picture  superiority  effects  were  largely  found  after 
1970  IS  that  the  faaUtating  conditions  had  been  made  more  clear.  Pictures  effects,  like  most  other 
mstructional  aids,  do  not  genendize  to  all  instructional  situations.  It  is  clear  that  there  are  contexts 
what  p— urcs  do  not  faciUtate  leaming  due  to  distraction  effects  and/or  the  inability  of  some  readers 
to  shift  attendon  from  pictures  to  text  However  ample  contexts  exist  where  pictures  appear  very 
useful  mfacihtatmg  reading  achievement  Dominant  conclusions  drawn  from  this  research  are-  1) 
pictures  are  superior  over  words  for  memory  tasks;  2)  adding  pictures  (external  or  internal)  to  prose 
leamng  facihtates  learning  assuming  that  the  pictures  are  congruent  to  the  leaming  task;  3)  childrca 
"Pj^f  of  9  or  10  rely  more  heavily  on  extemaUy  provided  pictures  than  older  children; 

and  4)  children  do  not  automatically  or  spontaneously  foim  mental  images  when  reading. 
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Review  of  Animation  Research 

c^.H5.c  ?*^!^L?®        Ubiquitous  presence  of  animation  in  educancnal  software,  surprisingly  few 
studies  have  been  reported.  A  variety  of  non-experimental  work  has  been  reported  >Sa  Sation 
''SSP?  •  ^^"^^  ^i^'  Dii«ct«Vof  the  Research  l^^artmcmctfcScTSS' 

has  rcpOTted  encomaging  results  using  ccmputer  animation  during  1  Jguage  activiSor  heS 

retS^f^m*  IT'- 1979).  Other  uses.ofcompuir  am^^o?^SclS?e  woIlT^^^ 
perception  research  (Proffitt  &  Kaiser,  1986)  and  testing  (Hale,  Oakey,  Shaw  &  Bums  1985^ 
Empincal  studies,  Aough  rare,  have  been  reported.  TTie  puipose  oSsS  is  foZefly 

Si  °"tJS;^''  ^  '""P"^  anim..tionSradjunct  or  alS  ^Son 
strategy  on  learning.  Table  1  provides  a  summary  of  tiiis  review. 


Insert  rable  1  About  Here 


^^^^yj'^pi  t  J  Investigate  systematically  the  instructional  effects  of  comouter  eranhics 
was  reported  by  Rigney  and  Lutz  (1975).  Forty  undigraduate  coltege  sSte  SShfa 
&;?an?d,^^^^^^  '"^y  ^uiSTeam^ng  J,SX^  ' 

D^nSn  SSlIT^  r'"P'  "^"^8  «        presentation  versus  a  pictorial 

presentation  which  included  animation.  Hi^er  scores  were  reported  for  the  oictorial  orcsentiition 

rrSr?LSvrHl*?r^S?^;;„rn^^^^  SsgSS^^SrSeTsson 
«JSS^ri^S  »K-  study  failed  to  discnminate  between  the  effecte  of  still  graphics  and 

SSm  "^"^  "  P^''"'    ""^^''^     1«^8  S'^s  solely  to 


King  (197^)  compared  three  presentation  inodes:  1)  no  graphic  (text  onlv)- 2)  text  olus  the 
use  of  sdU  visuals;  and  3)  text  plus  animated  visuals.  Forty-five  NS^tSJLgs^ 

mJ^T^n^     •  ^  groups.  Suice  the  subjects  were  older  and  probably  liad  already  refined 

thdr  dqiendence  on  external  imager^  was  liobablySnT 

rt^St Si^^V^h^?^'^^ P     1««»^8  ^^^^ not suffidently difficult 
(i.c.  ceihkig  cffecte);  2)  the  cntenal  measures  were  heavily  weighted  veit)aUy;  and  3)  the  oudeness  of 

^ShlmSfnStSS^''  ^'^^K^'  ^     host  computer.  The  use  rfolder  subieSsTa  ciuSaS^ 
perhaps  confound  ng  viable  for  most  of  the  computer  animation  studies: 

««,n„tSTc'S!;ji*^'  ^l^S  appliottion  of  the  SCHOLAR 

S  uistrucdon  system.  T  xtc  lesson  versions  utilizing  map  features  in  the  teaching  of 

SJlatiZln  l^^^y       '°"P^^"  1>  ^'^'l^*       2)  static  tabeled  map;  and 
untateled  map  The  interactive  map  condition  consisted  of  a  computer  graphic  map    Soui  America 
w^ih  bhnking  dots  maAing  cities.  During  the  tutorial  lesson,  an  iJterac^if  betv^n  Ae  sSSem^^ 
mi^  (hsplay  was  estahUshed.  Student  answer,  were  reinforced  appropriately  veri>ally  «Ki  ™Slv 
wiA  blmkmg  dots).  The  static  labeled  map  condition  used  SCaO^c^  lt^i^tSX 
the  stijlent  couU  look  at  a  labeled  map.  TTie  unlabeled  condition  was  identidd 
condmon  except  that  the  student  was  given  an  unlabeled  map.  The  study  was  cSdu^E^  parts- 
SSenif^  RfS         high-school  students,  then  repliS  with  a  grJup  of^e^^iS^  ^ 
JSSJril  ^"Plf  ."'d^cai^l  A«  the  interactive  map  condition  was  supSor  to  the  labeledSp 
SSln^     S  "."T  '"ff "'^ ""1*^1«1  "«P  «>ndition*!lT,is  study  ind^caSf^ 
^^S^  ofanmiatcd  over  static  visuals.  However,  the  instructional  intent  ofSe 

ammation  appeared  to  be  as  an  interactive  dynamic  rather  thar.  as  an  adjunct  presentoticm  stSteey 

2?suS'rSJ^?t^r"^«"'^"-'^^^'*"^P*^  n.e^SS'ytwn^ber 
or  suDjects  per  treatment  also  warrants  cautious  interpretation 

Moore,  Nawrocki  and  Simutis  (1979)  studied  the  foUowing  diree  presentation  modes:  1)  text 
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plus  schematic  representations;  2)  text  p?us  line  drawings;  and  3)  text  plus  animated  line  drawings. 
Ninety  enlisted  military  personnel  participated  in  this  lesson  which  involved  the  psjxhophysiology  of 
audition.  The  subjects  were  testrd  for  retention  of  facts,  terminology,  identification,  and  principles. 
No  signiHcant  differences  between  the  three  presentation  modes  were  rtpc^ctcd.  Again,  however, 
methodological  anomalies  likely  'veakened  the  ability  to  detect  differences.  Subjects  in  all  treatments 
were  required  to  answer  review  questions  after  each  of  the  four  lesson  pans:  if  tiiey  could  not  answer 
85%  of  the  qucstioiis  correctly,  they  were  forced  back  through  the  section  until  attaining  the  85% 
criterion.  For  this  reason,  subjects  probably  reached  ceiling  levels  before  taldng  the  posttest  Since 
only  die  posttest  scores  were  used  in  the  data  analysis,  it  seems  likely  that  potentiri  lesson  variation 
influences  were  masked. 

J.  Caraballo  (19^5)  studied  the  use  of  animation  using  the  following  four  treatment  variations: 
1)  no  instructicHi  (used  as  a  control);  2)  text  only;  3)  text  plus  still  visuals;  and  4)  text  plus  still  and 
animated  visuals.  Eigjity  college  seniors  and  graduate  students  participated  in  this  study  which  taught 
the  parts  and  internal  processes  of  the  human  heart  Once  again,  no  differences  were  reported 
between  the  text  only  and  the  otho-  groups  using  visuals.  The  age  of  the  subjects  is  again  cited  as  a 
possible  source  of  confounding.  Additionally,  the  lesson  locations  where  die  visuals  were  placed 
were  not  systematically  derived  It  is  not  possible  to  determine  if  the  embedded  visuals  were  even 
needed  to  support  the  lesson. 

A.  Caraballo  (1985)  studied  the  following  lesson  presentations:  1)  text  only;  2)  text  plus 
visuals;  and  3)  text  plus  still  and  animated  visuals.  A  total  of  109  college  seniors  and  ^:aduatc 
students  participated  The  lesson  content  taught  computation  of  area  of  geometric  shapes.  No 
significant  differences  between  the  groups  were  repcmed.  This  study  appeared  to  follow  appit^riate 
instructional  design  procedures:  two  pilot  studies  using  only  die  first  treatment  were  conducted  to 
validate  the  materials  and  also  to  determine  where  additiomd  lesscm  support  was  needed.  Despite  this, 
tfiere  arc  two  factors  which  may  have  served  to  confound  the  results.  First,  again,  an  older 
population  was  used  as  subjects.  Second  the  instructional  result  of  the  animation  appeared  to  be  as 
ail  aid  to  conceptual  understanding  rather  than  presentation.  Animativ  i  was  used  to  only  indiiecdy 
show  the  relaticHiship  between  geometric  shapes  as  an  aid  in  canputing  area.  Geometric  shapes  were 
moved  on  the  screen  to  show  their  relationships.  For  example,  two  identical  triangles  were  animated 
to  demonstrate  how  they  form  a  parallelopam.  Generally,  most  college  seniors  and  graduate  students 
would  know  or  ronember  these  relationships  with  little  prompting.  For  this  reason,  the  addition  of 
animation  probably  had  mmunal  effect  <mi  overall  achievement 

Reed  (i985)  conducted  a  series  of  four  experiments  investigating  graphics  conditions  in  the 
teaching  of  a  varir ty  of  algebra  word  problems.  The  design  of  die  four  experiments  followed  an 
iterative  process  ^vhere  results  of  the  first  experiment  were  used  to  miprove  the  instructiMal  deliviiry 
in  the  second  experiment,  and  so  on.  Different  groups  of  30  undergr^uates  participated  in  each  of 
me  first  tiirec  experiments  and  in  each  of  the  three  conditions  compared  in  experiment  4  (for  a  total  of 
180  subjects).  Experiment  4,  studied  die  final  modified  lesson  across  three  conditions  and  across 
four  word  problem  types  (average-speed  problems,  tank  problems,  mixture  problems).  The 
experimental  conditions  for  each  word  problem  type  depended    die  results  fiom  experiments  1-3. 
Sevwal  hypodicscs  were  tested  including  effects  of  feedback  and  graphics.  Results  were  mixed 
according  to  die  word  problem  task.  Student  performance  on  die  mixrurc  problems  did  not  depend  on 
die  availability  of  graphics,  whereas  graphics  effects  were  found  for  tank  problems,  but  only  when 
paired  widi  die  additional  strategy  of  requiring  students  to  make  estimations.  These  results  suggest 
die  inability  of  students  who  are  novices  in  die  content  to  accurately  perceive  differences  in  animated 
graphic  iTCsentations  when  only  required  to  view  die  graphic  presentation.  More  accurate  perceptions 
^ere  elicited  when  die  graphic  representatim  was  coupled  widi  an  instructioaal  strategy  which 
required  learners  to  attend  more  to  die  information  contained  in  die  graphic. 

Rieber  and  Hannafin  (1988)  investigated  computer  animatim  as  an  orienting  aid  during 
insttuction.  This  study  differs  from  die  previous  studies  in  two  important  ways.  First,  die  previous 
studies  used  an  older  population.  College-aged  students  probably  do  not  benefit  ftom  instruc  Jon 
which  contains  additional  visual  elaborations  since  they  are  able  to  form  mental  images  widiout 
^tional  lesson  support.  The  Rieber  and  Hannafin  study  investigated  animation  using  1 1 1  fourth, 
fifdi,  and  sixdi  grade  students — a  sample  fix>m  a  population  expected  to  benefit  mwe  from  visual 
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elaborations  than  adults.  The  second  rn^or  difference  concerns  the  role  played  by  animation  in  the 
lessons.  The  potential  of  animation  to  support  lesson  material  in  previous  studies  was  limited  in  that 
motton  and  trajectory  were  not  necessarily  criterion  aspects  of  the  content  to  be  learned.  Tb'»  study 
used  animation  on  the  basis  of  its  appropriateness  or  congruency  to  the  criterion  tasks.  The  lesson 
a)ntcnt  taught  Newtoman  physics  by  presenting  a  simplified  account  of  Newton's  laws  of  motion 
h^h  lessofi  part  was  preceded  by  one  cf  the  following  four  types  of  orienting  activities:  1)  text  only; 
2)  animation  only;  3)  text  plus  animation;  and  4)  no  orienting  activity  (control).  No  significant 
differences  were  reported  among  the  four  treatments.  They  reported  that  the  nonsignificant 
differences  may  have  been  due,  at  least  in  part,  to  the  general  ineffectiveness  of  orienting  activities  as 
GarK  IsS?"  suggested  in  other  research  such  as  Hannafin,  PhiUips,  Rieber,  & 

Rieber  (in  press)  foUowed-up  this  research  to  investigate  the  effectiveness  of  animation  when 
part  ot  the  pnmaiy  presentation  of  relevant  content  In  this  study,  visual  elaborations  of  the  laws  of 
motion  content  used  ui  the  Rieber  and  Hannafin  (1988)  study  were  embedded  throughout  the  lessoa. 
The  placement  of  these  embedded  visual  elaborations  were  determined  by  two  pUot  studies  using  an 
all-text  veraon  of  the  content  Student  deficiencies  in  meeting  the  objectives  tested  in  the  posttesi 
were  traced  back  to  the  lesson  presentation  and  then  strengthened  with  the  embedded  visual 
elaborations  ui  Uie  nain  experiment  The  main  experiment  studied  the  crossed  effects  of  graphic 
(static,  animated)  and  textual  (text,  no  text)  embedded  lesson  elaborations  and  practice  (relevant 
inelcvant)  on  factual  and  application  learning  of  192  elementary  school  students.  Relevant  practice 
consisted  of  ^g  traditional  multiple-choice  questions  after  each  of  the  four  lesson  parts.  No 
significant  differences  were  found  among  the  groups.  Several  exptenations  were  suMcsted  First 
the  studcnte  apparentiy  found  the  lesson  content  exceedingly  demanding  which  may  have  served  to 

^f-         ^"^^  fo"o^j"P  analysis  of  the  time  spent  by  student  viewing  lesson 
trames  containuig  embedded  visual  elaborations  suggested  that  students  may  not  have  adequately 
attended  to  the  visuals.  —i  ^ 

A  ca  ,^9^'  ^^^fl  replicated  the  previous  study  with  several  modifications.  First,  the  lesson 
difficulty  m  tenms  of  factaal  and  concept  density  was  reduced.  Second,  the  mediod  used  to  display 
lesson  iitfomaaon  was  changed  in  order  to  better  cue  students  as  to  what  to  select  and  attend  to  in  the 
l«5Son.  in  the  Rieber  (m  press;  study,  an  entire  frame  was  presented  to  Uie  student  at  a  time  witn 
audent  ablcto  tngger  tiie  next  frame  by  pressing  Uie  space  bar.  In  tiie  Rieber  (1988)  study,  each 
frame  was  broken  down  into  textual  and  graphic  "cnunks".  RaUier  dian  presenting  an  cntrc  fiaae  of 
uiftwmation  at  a  time,  each  student  viewed  only  a  portion  of  the  frame  at  a  time,  pre^g  the  space  bar 
when  ready  lo  view  Uie  next  portion  or  "chunk".  This  procedural  change  was  mSst  dramatic  inSTe 
presentation  of  animated  inftmnation.  Sttidents*  attention  was  more  easUy  directed  to  and  less  likely 
to  be  distracted  away  from  die  animat  *  presentation.  Practice  was  also  stiidied  in  the  form  of 
traditional  questiorang  techniques  b»  aso  as  dynamic  interactions  consisting  of  levels  of  a  structured 
smiulation.  Results  indicated  Uie  ai  jnated  graphic  group  was  superior  to  ^oUi  Uie  static  graphic  and 
no  graphic  grw^ps.  Also,  students  in  Uie  interactive  dynamic  practice  group  outpeiformcd  die  no 
practice  conti^l  pcup  whereas  Uie  question  practice  group  did  not.  An  interesting  interaction  was 
found  between  the  visual  elaboration  and  practice  factors.  The  animation  effect  was  eliminated 
without  any  form  of  practice.  Practice,  of  eiuier  type,  seemed  to  direct  students'  attention  to  relevant 
octaus  ui  the  tutonal.  AnoUier  uiteresting  finding  was  animation's  influence  on  incidentiU  learning 
The  anmiation  pxnip  iaw  a  graphic  example  of  Newton's  second  law.  In  one  frame,  graphics  of  a 
small  ball  and  a  large  bnck  were  given  equall  /  strong  kicks.  TTie  acceleration  experiewedby  Uie  baU 
was  dramaticaUy  greater  Uian  Uie  brick.  AlUiough  no  formal  attempt  was  made  to  teach  Uiis  rule  s 
^p  seemed  to  learn  tfiis  application  of  Newton's  second  law  based  solely  on  viewing  Uiis  one 

Rieber,  Boyce.  and  Assah  (1988)  repUcated  die  Rieber  (1988)  study  wiUi  141  adult  learners, 
nie  puipose  of  this  study  was  to  investigate  wheUier  Uie  animation  effects  on  young  children  would 
be  replicated  wiUi^ults.  The  same  lesson  content  was  used,  but  was  extensively  modified  for'Uie 
adult  group.  No  differences  were  reported  between  Uie  visual  elaboration  conditions  on  Uie 
pertoimance  measure.  This  is  consistent  wiUi  previous  research  using  adult  subjects.  However,  an 
analysis  of  subjects  response  latency  on  Uie  posttest  indicated  Uiat  subjects .  j  Uie  animated  visual 
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condition  took  significantly  less  time  to  answer  posttest  questions  than  subjects  in  either  of  the  other 
visual  conditicms.  Thus,  the  animated  visual  presentations  appeared  to  aid  subjects  in  the 
recOTStniction  process  during  retrieval.  Also,  a  moderate  interaction  between  the  visualizaticMi  and  the 
practice  factas  was  noted.  This  interaction  indicated  the  trend  that  the  static  graphic  and  no  graphic 
groups  were  influenced  more  by  practice  than  As  animated  graphics  groups.  This  inq)lies  that 
subjects  in  the  animated  graphics  group  did  not  require  the  additional  elabwation  and  rehearsal 
contained  in  the  practice  as  much  as  subjects  in  the  static  graphics  and  uo  graphics  groups. 

A  variety  of  other  related  research  has  been  reported  Riding  and  Tite  (1985)  found  tfiat 
conaputer  generated  animated  visuals  effectively  piompted  nursery  school  subjects  to  generate  aiginal 
stcmes  as  compared  to  static  visuals  and  a  control  condition.  Many  non-computer  studies,  involving 
primarily  video,  have  been  conducted  over  the  past  25  years.  Spangenberg  (1973),  for  example, 
taught  and  tested  procedural  learning  skills  (the  disassembly  of  a  machine  gun)  with  adults.  He  found 
motion  sequences  superior  to  stills  but  this  effect  was  eliminated  when  the  stills  condition  was  revised 
and  retested  (in  odier  words,  tfie  instructional  design  was  inqnoved).  Blake  (1977)  used  static  and 
animated  arrows  in  video  instruction  to  cue  subjects'  attention  to  the  movement  of  chess  pieces.  This 
s^y^t^nttOl?^  aptitude  of  subjects  and  found  that  subjects  of  low  spatial  aptitude 

benefited  from  motion  sequences  whereas  no  effect  was  found  for  subjects  with  high  si;««tial  aptitude. 
FinaUy,  Goldstein,  chance,  Hoisington,  and  Buescher  (1982)  found  that  subjects  recogniiion 
memory  was  s^ienor  for  dynamic  video  scenes  as  compared  to  static  video  scenes  ftom  selected 
exasrpts  of  HoUywood  movies.  (Sec  Chu  &  Schramr .,  1979  for  a  further  review  of  early  m  >tion 
studies  m  television  research.) 

Samm. 

Frequently,  results  from  the  King  (1975)  and  Moore,  Nawrocki,  and  Simutis  (1979)  studies 
areatcd  as  conclusive  evidence  that  animated  instruction  is  ineffective.  Qeariy,  these  two  studies 
hardly  represent  S'rffiaent  research  data  to  support  such  a  conclusion.  Some  of  the  reported  research 
hmts  at  conttr.ts  where  animation  has  at  least  some  empirical  support  witii  certain  populations. 
Uuldren  s  teammg  of  certain  science  concepts  when  the  difficulty  level  is  matched  witii  ability  is  one 
example.  The  cffert  of  animation  on  incidental  learning  also  warrants  further  study.  OUier  research 
(e.g.  A.  Caraballo,  1985;  Collins,  Adams,  &  Pew,  1978)  which  studied  animation  as  an  interwitive 
dynamic  or  as  an  aid  to  conceptual  understanding,  where  differentiated  effects  of  animation  are 
diiticult  to  distinguish,  perhaps  present  more  questions  tiian  they  answer. 

Conclusions  and  Prescriptions 

Guidance  in  the  application  of  computer  animation  in  instruction  is  needed,  especiaDy  as  the 
technology  continue  to  evolve  and  expand  to  include  such  things  as  three-dimensional  animation 
(iUvotica,  1987).  The  fbUowmg  conclusions  and  prescriptions  are  not  meant  to  represent  the  final 
word  on  instnictional  applications  of  animation,  but  as  temponur  assistance  to  practitioners 
Additionally,  it  is  hoped  that  tiiese  wiU  act  as  a  catalyst  for  more  i^scarch  and  discussion. 

jMtlensearfih  exists  whkh  has  stu^^^ 
staae  Hsuab.  One  obvious  conclusion  from  the  several  studies  reviewed  here  is  Uiat  the  pool  of 
available  aiumated  visual  rescrach  is  generaUy  small.  AdditionaUy,  several  of  the  reported  sttldies 
failed  to  qrstematicaUy  investigate  the  relative  unique  contribution  of  animation  as  compared  to  static 
visuate.  That  is,  flie  uraque  instiuctional  contribution  of  animated  visuals  is  stiU  largely 
unsubstantiated.  Qeariy  more  research  is  needed 

In  general,  animation  has  not  proven  to  be  an  effective  or  reliable 
presentation  strategy  when  considered  or  studied  separately  in  controlled 
experiments;  any  effects,  if  real,  are  sifbOe.  This  is  the  issue  of  efficacy.  Animation  does 
not  appw  to  be  a  powerful  influencer  on  icaming.  Effects  attributable  to  animation,  if  any,  arc 
puhaps  dq)endart  on  odier  lesson  compcnents,  such  as  lesson  organization  or  practice.  For 
example,  the  Riebcr  (1988)  study  indicated  an  interaction  between  animation  and  practice  such  that 
animation  was  only  effective  when  moderate  amounts  of  practice  were  also  provided  Those  who 
design  lessons  which  foUow  poor  instructional  designs  can  expect  Uttie  from  additional  special  effects 
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(like  animation)  and  instead  should  probably  expect  detrimental  effects,  like  distraction. 

Th^  instructional  intent  of  animation  should  be  based  on  the  instructional 
result  desired.  Perhaps  this  akin  to  beating  the  proverbial  dead  horse,  but  it  should  be  clear  by 
now  that  there  are  many  ways  in  which  animated  visuals  can  be  used  Haphazard  integration  of 
animatiOT  can  lead  to  a  variety  of  instructional  outcomes,  not  all  of  which  ai«  positive.  Designers 
should  carefully  consider  their  instructior.al  intent  and  how  closely  it  will  influence  the  desired 
instructional  result.  The  taxonomy  of  instructional  applications  of  animation  wa.'  offered  as  a  guide  in 
this  process. 

Animation  should  be  incorporated  only  when  its  attributes  are  congruent  to 
the  learning  task,  otherwise,  distraction  ejects  may  result  If  the  demands  of  the 
learning  task  involve  the  attributes  of  visualization,  motion,  and  trajectory,  such  as  many  objectives  in 
science  educati<Mi,  then  a  supporting  rationale  exists  for  incorporating  animation.  If  these  attributes 
do  not  attribute  to  the  learning  task,  then  the  learner  may  be  distracted  by  their  presence. 

Evidence  suggests  that  when  learners  are  novices  in  the  content  area,  they 
may  not  know  how  to  attend  to  relevant  cues  or  details  provided  by  animation. 
Details  provided  in  animation  that  experts  see  as  obvious  or  clear  may  be  completely  overlooked  by 
novices.  That  iS,  the  learners  may  be  unable  to  "rrad"  animated  visuals  nor  be  able  to  integrate  with 
yerijal  descriptions  (cf.  Rieber,  1988;  White,  1984).  This  is  especially  important  to  note  when 
instruction  is  designed  by  a  content  expert,  as  is  frequently  the  case.  Care  should  be  taken  to 
dchberately  cue  tlu.  learner  to  watch  for  the  details  in  the  aninution  which  are  most  relevant  (eg 
changes  in  speed  arid/or  direction). 

Some  aptitude  by  treatment  interactions  (ATI's)  between  learner  mtOuration 
and  spatial  aptitude  and  animation  suggest  favoring  the  use  of  animation  in  certain 
cases.  Although  virtually  no  specific  instructional  animation  research  on  this  point  is  available  (an 
exception  includes  Blake,  1977),  several  ATI  recommendations  can  be  extrapolated  from  general 
research  Research  indicates  that  internal  mental  imagoy  is  developmental  in  nature.  Young  children 
are  less  litely  and  less  capable  thai  adults  to  fam  internal  mental  images  spontaneouslv 
Additionally,  individual  differences  exist  in  overall  spatial  abiUty.  Therefore,  when  the'attriuutes  of 
the  leanung  task  are  congruent  to  the  attribute?  of  animation,  young  children  and  other  individuals 
who  possess  less  spatial  ability  shouM  particularly  benefit  from  the  use  of  these  visuals. 

Afore  dramatic  benefits  of  animation  may  tie  in  its  contributions  to  CBI 
applications  i  chas  interactive  dynamics.  Many  reported  studies  suggest  that  animation's 
greatwt  potential  may  lie  in  its  use  as  an  interactive  dynamic.  Unfortunately  however,  it  may  not  be 
possible  to  adequately  partial  out  animation's  distinguishable  role  when  used  in  this  way.  That  is, 
interacQve  dynamics  represent  highly  sophisticated  and  complex  exchanges  or  "transactions"  between 
the  student  wd  the  instruction  which  cannot  be  broken  down  easily  into  its  representative  parts, 
which  includes  for  example,  animation.  However,  the  fact  'Jiat  these  instructional  transactions  would 
not  be  possible  without  animation  attests  to  its  utility  in  ihis  area. 

Instructional  design  and  learning  theory  should  drive  the  use  of  animated 
visuals,  and  not  simply  what  the  hardware  is  capable  of  doing.  Technical  abilities  of 
hardware  and  programmers,  in  and  of  themselves,  have  no  bearing  on  dieir  potential  instructional 
effectiveness.  The  fact  that  animation  is  an  q)tion  does  not  mean  that  it  should  be  an  option.  CBI 
designers  are  faced  with  a  curious  dilemma.  They  must  resist  incorporating  special  effects,  like 
Mimation,  when  no  rationale  exists,  yet  must  try  to  educe  creative  and  innovative  implications  from 
the  computer  medium.  Instructional  design  still  represents  the  recommended  process  for  identifying 
instructional  proW  ;ms  and  then  designing,  developmg,  and  evaluating  instructional  solutions  on  ihe 
computCT  or  with  other  emerging  technologies,  such  as  interactive  video  f  Jid  hypermedia  (Hann  Jin  & 
Rieber,  in  press). 

Closing 

The  general  failu  ^  uf  animation  to  impact  learning  empirically  contrasts  the  theoretical  bases 
(m  mental  'magery  and  visualization)  which  support  it.  However,  general  procedural  fiaws  in  several 
of  the  animation  studies,  as  well  as  a  lack  of  generality  of  results,  make  interpretation  inconclusive.  If 
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animation  is  an  effective  instructional  eleraenl,  its  influence  is  probably  not  as  evident  in  the  presence 
of  well-designed  and  organized  instruction.  It:  influence,  like  many  other  instructional  aids,  may  be 
weakened  in  the  presence  of  more  powerful  lesson  elements  (cf  Mayer,  1979).  In  addition,  the 
effects  of  animation  could  be  dependent  on  content  and  learning  task  variables. 

Designers  and  consumers  of  educational  software  and  emerging  technologies  should  approach 
insmictional  uses  of  animation  with  caution.  The  few  serious  attraipts  lo  study  the  instructional 
attributes  of  animation  have  not  adequately  shown  it  to  be  effective.  Although  it  is  expected  that  the 
conditions  under  which  animation  is  effective  will  eventually  be  empirically  derived,  adequate  and 
accurate  prescriptions,  beyond  the  general  orits  already  described,  are  not  available.  It  could  be  that 
the  discrepancy  of  expected  results  and  enq)irical  evidence  demonstrates  a  failure  on  the  part  of 
researchers,  rather  than  inappropriate  applications  on  tte  part  of  designers  and  instructors.  Research 
from  related  areas  should  serve  to  guide  educators  until  more  specific  research  data  is  available.  For 
exwiple,  the  potential  for  animation  to  distract  learners  should  be  noted  Related  research  has  also 
indicated  that  developmental  factors  may  be  involved.  Also,  the  way  learners  perceive  animation 
could  also  have  an  effect  on  learning.  Research  suggests  that  there  are  q)timal  levels  of  motivation 
and  arousal  for  many  instructional  craiponmts.  When  learners  perceive  conqxxients  as  requiring  too 
litde  or  too  much  effort  there  is  a  tendency  for  them  not  to  attend  to  the  iastruction  appropriately 
(Salomon,  1983).  -rr 

The  research  effort  in  static  visuals  rraresents  pertuq)s  a  curious  analogy  to  the  current 
research  in  animation.  Research  priw  to  1970  largely  concluded  tiiat  adjunct  visuals  eitficr  had  no 
effect  or  negative  effects  on  learning.  Fortunately,  research  did  not  stq)  based  on  this  conclusion.  It 
took  more  time  coupled  witii  a  systematic  effort  to  finally  describe  the  conditions  under  which  static 
visuals  could  be  used  effectively  to  promote  learning  (Merrill  &  Bundcrson,  1981)  and  it  is  only 
recently  that  this  research  base  has  started  to  be  effectively  applied  to  instructional  computer  graphics 
(Alesancbini,  1987).  It  is  suggested  that  research  into  animated  visuals  will  require  a  similar 
systematic  process  and  effort  to  uncover  unique  conditions. 
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Summary  of  Empirical  Research  Studying  the  Instructional  Effects  of  Animation 
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Study 


Subjects 
#  Age 


Content 


Results  Regarding 
Animation 


Comments 


Rigney  &  Lutz,  1975  40  Adult 
King.  1975  45  Adult 


Collins,  Adams,  & 
Pew,  1978 


Moore,  Nawiocki,& 
Simutis,  1979 


18  Adult 


90  Adult 


Caraballo,  A.,  1985 


Reed,  1985 


Science:  How  a  Higher  recall  for 
batteiy  works       pictorial  group 

Math:  sine  ratio  NSD 


Geography  of       Interactive  Mq)> 
South  Arnica      Labeled  Map> 
Unlabeled  Msq) 

Psychophysi-  NSD 
(riogy  of  audition 


caraballo,  J.,  1985         109     Adult         Physiology  of  NSD 

human  heart 


109    *  Adult        Cdmputation  of  NSD 
area  of  geometric 
sliapes 


180     Adult         Algebra  word       Mixed  according 
problems  to  word  problem 

type 


RiebcT&Hannafin,  111  Children  Newton's  laws  of  NSD 
(1988)  (elem.;  motion 


Riebcr,in-Tess  192     Children      Newton's  laws  of  NSD 

(elem.)  motion 

Rieber,  1988  ii)     Children     Newton's  ?w:  of  Animadon>Statics 

(elem.)       motion  None;  Interaction  be- 

tween visuals  & 
practice 


No  control  for  static  vs. 
animated  visuals 

Learning  task  not 
sufficiendy  difHcult 

Animation  used  as  an  interac- 
tive dynamic,  not  as  an 
elabcvation  of  lessor^  content 

Confounding  due  to 
instructional  design:  review 
was  automatically  given 
to  students  after  each 
lesson  part  if  achievement 
less  than  8S%  thus 
imxlucing  a  ceiling  effect 

No  validation  done  to 
determine  if  additional 
visuals  were  needed 

« animation  used  as  an  aid 
to  conceptual  understand- 
ing, not  as  an  elaboration 
of  lesson  content 

Lessons  were  iteiatively  im- 
proved over  4  experiments; 
Animation  effective  when 
replacing  rather  than  sup- 
plementing verbal  info 

Animation  studied  in  con- 
text of  orienting  activity; 
possible  confounding 
due  to  lesson  difficulty 

Possible  confounding  due 
to  lesson  difficulty 

Animated  visuals  conbib- 
ution  distinguishable  from 
static  visuals;  animation 
most  effective  when  prac- 
tice support  was  moderate; 
niKXlerate  animation  effect 
in  promoting  incidental 
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if  the  bail  was  kicked  two  times.. 


0  seconds 


If  the  ball  was  kk:ked  two  times... 


5  seconds 


If  the  ball  was  kk:ked  two  times.. 


...then  two  kicks  in  the  opposite  directnn  wouki  be 
needed  to  stop  the  ball. 


READ  THIS  TWICE:  

When  an  object  at  rest  is  kk:ked,  an  EQUAL  kwk  in  the 
OPPOSITE  directbn  is  needed  to  stop  it  (when  there  is 
no  gravity  or  frictbn). 


Pre—  <SPACE  BAR>  after  studying 


12  seconds 


PiWrer  An  example  of  using  animation  as  an  adjunct  presentation  strategy/ 


in  science. 
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Animation  Review  20 


EgUffi^.  An  example  of  using  animation  in  an  interactive  dynamic:  the  student  is  in  control 
of  a  free-floatuig  starship"  attempting  to  dock  with  the  "parent"  ship. 
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The  Effects  of  Computer  Animated  Lesson  Presentations  and  Cognitive  Practice 
Activities  on  Young  Children's  Learning  in  Physical  Science 


Abstract 

The  purpose  of  this  study  was  to  examine  the  effects  of  animated  instruction  and  levels  of  practice  on 
application  learning  in  a  computer-based  instructional  (CBD  science  lesson.  A  total  of  1 19  fourth  and 
fifth  grade  students  participated  in  an  introductory  lesson  covering  Newton's  Laws  of  Motion.  Three 
levels  of  Visual  Elabwation  (Static  Graphic,  Animated  Graphic,  No  Graphic)  were  crossed  with  three 
levels  of  Practice  (Behavioral,  Cognitive,  No  Practice).  Behavioral  Practice  consisted  of  traditimal 
questioning  after  each  of  four  lesson  parts.  Cognitive  Practice  consisted  of  a  structured  simulation 
where  students  were  given  increasing  control  over  an  animated  "starship".  Main  effects  was  found 
for  both  Visual  ElaboraticHi  and  Practice.  An  interaction  was  also  found  between  Visual  Elaboration 
and  Practice.  Other  data,  such  as  response  latency,  attitudes,  student  perceptions,  and  incidental 
learning,  was  also  collected 


Introduction 

One  of  die  goals  of  instructional  design  is  to  match  the  needs  of  instruction  witfi  the 
capabiUties  of  the  delivery  system  (Gagnc*,  Briggs,  &  Wager,  1987).  This  implies  that  lesson  design 
should  be  derived  from  learner  and  instructicmal  variables,  rather  than  machine  variables.  However, 
given  the  fact  that  new  technologies  provide  new  instructional  design  opportunities,  instructional 
designers  must  consider  which  instructional  attributes  of  a  given  delivery  system  actually  delivciy  the 
most  apprc^riate  external  lesson  events  in  order  to  activate  die  internal  learning  processes  which  meet 
the  lesson  goals  and  objectives. 

Many  pitfalls  plague  die  introducticm  of  a  new  technology  to  education  (Salomon  &  Gaixiner, 
1986).  A  common  tendency  when  designing  instruction  with  a  new  technology  is  to  mimmick  the 
status  quo"  in  an  older  or  traditional  technology  (Siegel  &  Davis,  1986;  Strcibcl,  1986).  In  contrast, 
new  technologies  have  historicaUy  been  prone  to  die  misconception  diat  diey  are  innately  superior  to 
traditional  apprcxaches.  This  latter  pitfall  has  experienced  a  cycle  of  reoccurencc  during  die  past  30 
years  widi  such  "new"  technologies  as  progranuned  instructicxi,  instructional  television, 
computer-based  instruction  (CBI),  computer  programming  (e.g.  L(X50),  and  more  recently 
interactive  video  (Salomon  &  Gardner,  1986).  dark  (1983, 1985)  has  warned  and  cautioned  against 
encouraging  this  misconception  quite  convincingly. 

While  it  is  generally  agreed  diat  CBI  is  just  anodier  instructional  medium  which  acts  as  die 
delivery  "truck"  for  instruction  (p.  445,  Clark,  1983),  it  is  contended  diat  die  potentials  of  CBI  have 
/Piio^^^       ^""y  realized  (Hannafin  &  Rieber,  1986;  Streibel,  1986).  Salomon  and  Gaidner 
(1986)  have  stated  tfiat  "researchers  have  learned  diat  only  specific,  relatively  unique  features  of  a 
inediuni  make  a  difference"  (p.  14).  Many  features  of  CBI  appear  to  offer  instmcticMial  opportunities 
which  might  be  able  to  make  a  difference — features  which  are  difficult  or  impossible  to  incorporate 
widi  most  odier  media.  Animation  is  one  such  feature. 

There  is  a  strong  and  rich  historical  perspective  diat  humans  are  particularly  adept  visual 
learners.  The  research  of  Paivio  (1979, 1983)  and  odiers  antraub,  1979;  Kobayashi,  1986;  Kosslyn, 
Holyoak,  &  Huffman,  1976;  Madigan,  1983)  have  expressed  an  apparent  processing  "partnership" 
between  verbal  and  visual  learning.  According  to  diis  dual-coding  dieory,  wwds  and  pictures  activate 
uidependent  visual  rnd  verbal  codes.  When  die  information  to  be  learned  is  highly  imageable,  a 
leamer  is  aUe  to  encode  die  information  into  long  term  memory  (LTM)  using  botii  a  verbal  and  visual 
^ace.  This  redundant  encoding  incitases  die  probability  of  retrieval  since  if  one  memory  trace  is  lost 
(whether  visual  or  verbal)  the  odier  is  still  available. 

The  dual-coding  perspective  presents  a  dieoreticalundttpinning  to  support  die  use  of  visurf^ 
whedier  static  or  animated,  in  instruction.  Recent  reviews  support  die  use  of  instructional  visuals 
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(Dwyer.  1978;  Kobayashi.  1986;  Levie  &  Untz,  1982;  Levin  &  Lesgold.  1978).  However,  it  is 
unccrtiuii  whether  animated  visuals  offer  anything  unique  to  instruction.  Typically,  CBI  has  used 
animation  to  create  uitere^g  (and  potentially  distracting)  lesson  rcinforcen.  A  need  exists  to 
detcmiine  what  natures  of  animation  have  the  potential  to  support  instruction  more  directly, 
iiiterestmgly,  resulte  from  most  animation  studies  have  not  supported  the  contention  that  animated 

^A^  (Caraballo.  1985;  King.  1975;  Moore.  Nawrocki. 

&  Simutis,  1979;  Riebcr  &  Hannafin,  1988;  Rieber,  in  press). 

^      ^^'^^F^^fC^^^^^^  ^°  attributes  beyond  that  of  static  visuals:  motion  and 
O^^ctory  OOcin,  1987).  Therefore,  animated  visuals  should  be  mcst  effective  when  the  attributes  of 
motion  and  trajectory  are  congruent  to  tiie  demands  of  the  insauctional  task.  Instruction  in  physics 
presents  many  examples  of  this.  Research  has  shown  that  many  students  have  deep-seated 
SSS2S!^ti?°"«  P**^"^  laws  (diScssa.  1982)  and  traditional  instruction  often  serves  to  conflict 
.SSS!??^  *fl  (Champagne.  Klopfer.  &  Gunstone.  1982).  Designing 

instruction  to  include  verbal  dcsoiptioas  as  weU  as  animated  descriptions  of  "motion"  concepts 
shouW  improve  leanung.  If  the  conopts  to  be  learned  include  motion  and  trajectory,  then  tiw  proper 
use  of  ammauon  is  believed  to  have  the  potential  to  increase  learning  through  a  visual  elaboration 
Cr^S;  Sfilf ™2J  ?f P«fC"»tio"      task  variables  is  one  groundrule  cited  in  the  review 
SiiS^  ^^r^-  ^^V^^  for  Ac  efficacy  of  pictures  in  reading.  Sffercntiated  effects  between 
animatedand  static  visuals  is  contended  to  be  an  extension  of  this  groundrule. 

t^^  ^  T*?Ao  1!™*?°°."^  V^^^^        ^       studied  extensively  during  die  past 

n^S^^^Sf^""'  ^98^  and has  recentiy  been  studied  in  CBI.  CBI  smdies  have  shown 
nJiiS^Mf^r'*  *  very  powerful  influence  on  student  achievement  (Hannafin.  PhUlips.  Rieber.  & 
SS^^ii^ute  SSlJlS/'^P?'  *  ^'^PP'  1986).  Traditional  practici  is  operationally  defined  as 
S  SS^^SJ;  -fh?  nl""?^  insmiction  and  is  based  largely  on  the  pioneering  work  of  Rothkopf 
f^fi2,Sl2t^SJ?      °^  H»  *»s  a  more  behavioral  ap^oach  which  calls 

w^J^f?S«^  relevant  lesson  information  witii  appropriate  feedback  a!id  reinforcement 
rTfS^™?^  u     ^'  ^^7"°^  P^^*  '^^'^^^^  are  beUeved  to  most  effective  for  lower-level 
^\^^^'  "owcvcr.  CBI  agam  affords  many  different  appitwches  to  practice  which  provide  a 
K^^C^l^^fH"^^*^^^"'*  °l  ^  (Salisbury.  1988;  SaUsbS}.  Richards.TKkb! 

IS  h;ZTn2^.2y„ofPP^^       design  of  practice  activities  would  mo^e  actively  involve  the 
twch  cSLS  PS?^:.  of  dus  sort  would  encourage  mental  conflict  to  arise 

ttS^  IJSJ^^'^^-Sy  the  student  dirough  strategies  such  as  informal  hypotiiesis  testing. 
nJJ^^H  P?*^^  !»«»Y»?cs  which  encourage  varied  and  deeper  levels  of  cogiStive  processing  would 
^ti^^^L^L^T^  19^«> "  discquUibrium  (Slhe  Ptogctian  Jnse). 

&;rriuS5:?effir^^ 

flnnHr,iSf  iElS*  °^%T*^y  ""^i^  ^^V.^^  «ffects  of  animated  instmction  and  practice  on 
*  PL«»«^  lesson  with  concepts  related  to  motion  and  trajectory.  There 
AMeS^^EfS^?         '"^y-  ^)  l"^^'^'ion  would  be  more  effective  2,  presenting 

static  visuals  or  no  visuals;  2)  Cof  dve  Practice 
S^SjlJ^ri^rlT^^  process  over  content.  wouW  better  facilitate  higher-level  learning  than 

Methods 

Subjects 

central  TWrfc^^H^*"*  °^  ^  ?  ^'^^  S^*"  ^  a  rur^  public  elementary  school  in 

SnJr,„?-S  fifr^"Pf yoluiitary  and  selection  based  on  parent  consent.  A  total  of  55 
founh  and  64  fiftfi  graders  participated  with  an  average  age  of  10.41  years  (SD-..83). 

CBI  Lesson  Content 

mess)  dS^^Si^^?"'      <l«\eloped  for  previous  studies  (Rieber  &  Hannafin.  1988;  Rieber.  in 
press),  descnbed  and  explained  Isaac  Newton's  Uws  of  Motion.  The  les.son  was  divided  into  four 
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parts.  The  first  lesson  part  introduced  the  learner  to  Isaac  Newton's  formal  discoveiy  of  certain 
physical  laws  as  well  as  several  basic  principles  such  as  Newton's  first  law.  The  second  part 
introduced  the  concept  that  equal  but  opposite  forces  arc  needed  to  cause  objects  to  »tq).  This  section 
dealt  only  with  one-dimensional  space.  The  third  part  expanded  this  notion  to  include  tiie  effects  of 
unequal  forces  acting  upon  a  stationary  object  The  tiiiid  pan  also  presented  these  concepts  in 
one-dimensional  space.  Finally,  the  fourth  part  added  the  notion  of  twcxlimensional  space  to  the 
above  concepts.  All  instruction  was  presented  at  an  introductory  level.  Approximately  60  minutes 
was  required  to  complete  the  lesson. 

Lesson  Versions 

Three  levels  of  Visual  Elaboration  (Static  Graphic,  Animated  Graphic,  No  Graphic)  \me 
crossed  with  tiirce  levels  of  Pjractice  (Behavioral,  Cognitive,  None).  The  respective  practice  activity 
was  provided  immediately  after  each  of  the  four  lesson  parts. 

Behavioral  Practice.  Behavioral  Practice  consisted  of  5  multiple-choice  questions  presented 
after  each  of  tiic  four  lesson  parts.  The  questions  covered  tiie  relevant  material  in  that  lesson  part. 
Feedback  was  provided  to  the  students  in  tiic  forai  of  knowledge  of  conect  results.  This  practice  type 
is  termed  behavioral  due  to  the  largely  reinforcing  nature  of  the  practice  activity. 

CognitiYC  Practice-  Cognitive  Practice  consisted  of  an  activity  which  involved  the  student  in  a 
structured  simulation  involving  the  science  concepts.  Students  were  given  increasing  levels  of  control 
oyer  A  simulated,  free-floating  object  The  free-floating  object  was  called  a  "starship"  and  was 
represented  by  a  triangular  symbol  on  the  computer  screen.  For  example,  students  practiced 
increasing  and  decreasing  tiie  speed  of  tiie  starship  after  lesson  part  3  and  practiced  how  forces  acting 
on  an  object  in  90  degree  increments  affect  tfie  final  trajectoiy  of  tfie  object  in  two  dimensional  space 
after  lesson  part  4.  This  practice  activity  is  an  iq)plication  of  tiie  "dynaturtie  microwcrid"  develc^ 
by  diSessa  (1982)  and  otiiers  (White,  1984).  An  exanq)le  of  Cognitive  Practice  is  depicted  in  Figure 


Insert  Figure  1  About  Here 


No  Practice-  This  level  acted  as  a  control  No  practice  activity  was  given  to  the  student 
Students  in  tiiis  condition  progressed  sequentially  tiirough  the  lesson  parts. 

Each  of  the  three  levels  of  Practice  was  crossed  witii  tfute  levels  of  Visual  ElaboiBtion  (Static 
Graphic,  Animated  Graphic,  No  Graphic).  Visual  elaborations  were  added  to  tfiose  lesson  parts 
judged  as  tiie  most  difficult  and  most  needing  additional  instruction  as  determined  fn?m  previous 
research  (Rieber  &  Hannafin,  in  press;  Rieber,  in  press). 

Static  Graphic  The  textual  presmtation  of  tiie  science  instruction  was  supplemented  by 
embedding  static  graphics  throughout  die  lesson.  These  graphics  provided  static  illustrations  of  die 
sciaice  content.  Fwces  were  represented  graphically  by  a  foot  giving  an  object  a  kick,  such  as  ball 
Motion  and  trajectory  attributes  were  represented  by  arrows  and  path  lines.  An  example  of  a 
computer  screen  containing  a  static  graphic  elaboration  is  illustrated  in  Figure  2. 


Insen  Figure  2  About  Here 
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Ammated  firapflK?.  The  supplemental  instmction  was  in  the  form  of  supportive,  animaied 
graphics.  TTus  condition  also  used  the  foot  and  ball  symbols  to  represent  an  object  being  acted  upon 
by  forces.  However,  the  ball  was  then  animated  to  demonstrate  the  vonsequences  of  the  forces  on  its 
movenienL  For  example,  a  stationary  ball  was  shown  being  kicked  two  times  to  the  right  The  ball 
was  ammated  across  die  screen  to  die  right  and  tfien  stopped  by  two  kicks  to  the  left.  This 
demonstrated  the  principle  that  an  equal  force  in  the  opposite  direction  is  needed  to  stop  the  object 
An  example  of  this  is  illustrated  in  Figure  3. 


Insert  Figure  3  About  Here 
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NpCraphic  This  level  also  acted  as  a  control.  No  visual  support  was  added  to  die  lesson  in 
this  condition.  The  textual  material  for  this  condition  was  identical  to  tiiat  provided  in  die  otiier  two 
conditions.  • 

Dependent  Measures 

Lesson  Pftsncst  The  posttest  consisted  of  26  questions  measuring  application  learning 
correspondmg  roughly  to  rule-learning  as  defined  by  Gagne  (1985).  Multiple-choice  questions  (1 
answer  and  4  distractors)  were  used  as  die  testing  fomaat  The  posttest  measured  student 
performance  on  the  following  six  lesson  objectives: 

1)  apply  the  rale  tiiat,  witiiout  any  outside  forces,  an  object  in  motion  wiU  remain  in 
motion  and  an  object  at  rest  will  remain  at  rest  (Newton's  First  Law); 

2)  apply  the  nde  tfiat,  in  one-dimensional  space,  when  an  object  at  rest  is  put  into 
^^^1^  *  ^^'^       applied  in  die  opposite  direction  is  needed  to  stop 

3)  apply  the  rule  tfiat,  in  one-dimensional  roace,  when  an  object  at  rest  is  acted  on  by 
unequal  forces,  the  final  spad  of  die  object  is  die  result  of  die  sum  of  die  forces 
acting  on  die  object  from  both  sides; 

4)  apply  th3  rule  diat,  in  one-dimcnsjona  space,  when  an  object  at  rest  is  acted  on  by 
unequal  forces,  the  nnal  jn^SSSaO.  of  die  object  is  die  result  of  die  sum  of  die  forces 
acting  on  die  object  from  bodi  sides; 

5)  apply  die  rule  diat,  in  two-dimensional  space,  forces  occurring  at  right  angles  to 
each  odier  act  independendy  on  tiie  object  (ordiogonality);  and 

6)  apply  Newton's  second  law,  summarized  by  die  equation  force=iTiass  times 
acceleration  (F=ma). 

Objectives  1  to  5  are  listed  hierarchicaUy  such  diat  each  objective  (starting  widi  1 )  is  generally 
^  next  Masteiy  of  later  objectives  is  beUeved  to  be  dependent  ujon 
mastoy  ofdie  eailier  objectives.  Objective  6  was  not  intcntionaUy  taught  in  die  lesson  material,  but 
was  inaphed  only  in  die  ammatod  graphics  condition.  TTiis  objective  was  included  to  ny  to  measure 
TllS^Z^T^^^"^  °^  animation.  TTius,  die  six  objectives  are  listed  in  oider  of  difficulty 
fTt!?:  ^  ,5*?!?  °^  ^  C?^^^^  questions  was  approximately  half  all-veibal  and  half 
>^itaVwsi«l.  About  half  of  die  verbal/visual  questions  involved  animation.  No  feedback  was 
pro\ajtod  afto  each  question.  Shidents  were  not  given  dieir  performance  scores  at  die  end  of  die 
posttest,  instead  aU  were  informed  diat  diey  had  "passed".  KR-20  reliability  of  die  posttest  was  .87. 

B^mstLateDCX.  The  time  required  by  stiidents  to  answer  each  posttest  question  was 
moaancd  to  die  nearest  second.  Processing  time  was  measured  vs  die  time  required  by  students  to 
answer  each  of  die  posttest  questions  once  prompted  to  do  so.  TTie  prompt  was  die  final  text 
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displayed  on  the  screen  for  each  question. 

Attitudes.  Students'  general  attitudes  about  computers,  science,  and  the  lesson,  were 
surveyed  at  the  end  of  the  lesson  after  they  had  been  infOTmed  by  the  computer  that  they  had 
passed".  Additiwially,  students  were  asked  for  their  perception  of  lesson  difficulty.  All  of  these 
survey  questions  were  presented  using  a  five  point  Likert-type  scale  with "  1"  being  the  most  positive, 
"5"  the  most  negative,  and  "3"  being  neutral. 

Procedures 

All  instruction  and  tesdng  was  administered  by  computer.  As  students  arrived  to  the  computer 
lab,  they  were  randomly  assigned  to  one  of  the  treatment  groups.  Before  beginning  the  lesson,  all 
studente  were  ^iven  a  group  orientation  to  the  lesson.  The  orientation  provided  basic  inforaiation 
about  the  location  of  computer  keys  and  odicr  protocols  in  order  to  minimize  confusion  and 
distraction  during  the  lesson.  Once  instructed  to  begin,  students  completed  the  computer  lesson 
individually.  The  posttest  was  automatically  administered  to  each  student  upon  completion  of  the  four 
lesson  parts.  Immediately  after  completing  the  posttest  all  students  were  informed  that  they  had 
passed  the  lesson,  upon  which  the  attimde  survey  was  administered.  Approximately  one  hour  was 
needed  to  complete  the  lesson. 

Design  and  Datu  Analysis 

A  3  X  3  X  (6)  factorial  design  was  used  to  study  the  effects  of  the  instructional  variables  on 
studente  application  learning.  Two  bctween-subjects  factors  (Visual  Elaboration,  Practice)  were 
crossed  with  one  within-subjects  factor  (Learning  Objective).  The  bctween-subjects  factors  consisted 
of  time  levds  of  Visual  Elaboraiion  (Static  Graphic,  Animated  Graphic,  No  Graphic)  and  tinee  levels 
of  Practice  (Behavioral,  Cognitive,  No  Plactice).  The  within-subjects  faaor  consisted  of  ti»e  six 
Icamuig  objectives  which  also  served  as  a  dependent  measure.  Statistical  procedures  included 
mixed-effects  analysis  of  variance  (ANOVA)  and  Tukey's  studentized  range  test  for  follow-up 
multiple-compansons  on  mesons. 

In  addition,  two  separate  analyses  were  conducted  mi  the  response  latency  and  attitudinal 
variables.  ' 

Results  and  Discussion 

Posttest 

Percent  means  and  standard  deviations  of  student  posttest  scores  arc  contained  in  Table  1 . 
The  ANOVA  sumnary  table  is  contained  in  Table  2.  A  significant  main  effect  was  found  for  Visual 
Elaboration,  F(2,660)=6.09,  p=.Q02.  Students  in  the  Animated  Graphics  group  scored  significantiy 
higher  on  the  posttest  tiian  those  in  the  No  Graphics  or  Static  Graphics  groups.  No  significant 
difference  was  detected  between  the  Static  Graphics  and  No  Graphics  groups. 


Insert  Table  1  About  Here 


Insert  Table  2  About  Here 
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A  Mgnificant  main  effect  was  found  for  Practice,  F(2,660)=5.83,  /7=.u)3.  Students  in  the 
Loputivc  Pracdce  p)«jp  scored  higher  on  the  posttest  than  those  in  the  No  Practice  group.  Although 
SnS^u^  ^tice  group  mean  (57.3%)  was  lai:ger  than  the  Behavioral  Practice  group  mean 
(50.9%),  flus  effect  size  was  not  large  enough  to  be  significant  No  significant  difference  was  found 
l)etween  die  BehaviorBl  Practice  and  No  Practice  groups. 

significant  main  effect  was  found  for  Learmng  Objective.  F(5,66O)=21.86,p=.00Ol.  As 
eJ5>ected,  I«|nnng  wa.«?  not  unifonn  across  all  of  die  lesson  objectives.  Three  distinct  difficulty  ranges 
cmoBed.  OvotU,  students  perfonned  best  on  the  group  of  test  items  measuring  objectives  1 , 2, 3, 
wid  4  (mean=59.6%).  Next  in  difficuliy  were  the  questions  measuring  objective  5  (mean=44.8%). 
Finally,  students  found  test  items  for  objective  6  the  most  difficult  (mean=28.6%).  These  results 
partiaUy  suppoft  ttie  earher  contention  diat  die  objectives  were  hierarchically  organized.  Not 
surpnangly,  students  had  more  difficulty  on  objective  7  (just  above  tfie  level  expected  from  guessing) 
ance  this  objective  was  not  taught  dinecdy  in  any  of  die  treatnnents,  and  orJy  incidentally  in  die 
Animated  Graphic  tneatmenL  FbUow-up  analyses  indicated  a  nwrginal  effect  for  Visual  Elaboration 
00  this  objective.  Students  in  die  Animated  Graphic  treatment  outperformed  die  Static  Visual  and  No 
Visual  groups  at  p=.09. 

uiA  ^  detected  between  Visual  Elaboration  and  Practice, 

n4,oeo>=4j28,  /?=.002.  The  nature  of  dus  interaction  is  shown  in  Figure  4.  Students  who  received 
Betevioral  Practice  perfonned  best  on  die  posttest  when  also  given  instruction  presented  widi 
Animated  Graphics  dian  widi  Static  Graphics  or  No  Graphics.  Students  receiving  Cognitive  Practice 
did  not  vaiy  sigmficantiy  on  die  posttest  based  on  which  type  of  visual  elaboration  was  used 


Insert  Figure  4  About  Here 


Response  Latency 

n«orio.  mT"  -^^T  T  ^^H?**  ^(2.660)=1C.92.  p=.0001.  Students  who  received 

^r*.^"™    ^g«''v«)r  significandy  less  time  to  answer  die  posttest  questions  dian 
students  who  did  not  receive  practice. 

.  Learning  Objective,  F(5,660)=35. 19,  d=.0001  .  In  general, 

SSSi^  ^  questions  dian  easy  questions.  There  was  on?  exception 

«K,wSf^K    i'J'?"®^®*^'^™"'^''^  1  (die  easiest 

^SSS2l!fw**^^**  far  objectives  5  and  6  (die  most  difficult  questions).  This  exception  was  not 
predicted  and  IS  not  readily  mteipretable. 

Attitudes 

^A^^  on  attitude  wwe  found  for  eidier  Visual  Elaboration  (mean=l  .46)  or  Practice 
(mean=l.46).  OyaaU,  students  displayed  favorable  attitudes  (between  positive  and  very  positive) 
regardless  of  which  treatment  tiiey  were  given.  /  i'  / 

General  Discussion 

AWf^r^J^  °L*^       ^'^y^  of  mennt  levels  of  visual  elaborations  and 

diOCTwit  levels  of  practice  on  application  learning  in  a  CBI  science  lesson.  This  study  was  an 
extwision^  previous  research  uivestigating  instruction  using  computer  animation  coupled  with 
practta  activities.  TTie  sciena  material  covering  Newton's  laws  of  motion  was  chosen  for  its 
JSSl^SS''  ^il^^  °^         experience  widi  die  material,  and  i'is  obvious  congruency  with 
animated  instruction.  Previous  research  using  dus  material  demonstrated  diat  students  found  the 
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^^uZI^^I"  *  believed  to  explain,  at  least  partially,  why  no  differences 

S^c^ifJ^  Ti^-  the  lesson  material  was  extensively  modTied  in  die  present  study. 

hSS^IS      Zl^f  1*7^^?"^^  ^     mean  Scores  in  Table  i.     this  s3y. 

^  of  tfie  visual  elaboraaon  and  practice  activity  had  an  influence  on  student's 
appiicanon  learning  of  the  matenal. 

student  S!SS^^«"^'^J^^    elaborations  of  the  lesson  content  had  a  definite  influence  on 

f  compmtd  to  stetic  graphics  or  no  graphics.  All  of  the  lesson  objectives 
ZS^  ^^rSl     ^^-^  "^^""^  ^'^y  ^S^y  ^"al  in  nature,  but  also  cLcdy 

D^i^i^S^jJj'*'  °  n       •  hypothesized  that  students  who  were  ^ven 

SSr  rJTSS^^J'^  lustrations  and  examples  of  these  concepts  and  principles  would  be  S  a 
SS  riv^n  21^1^321^  ""^  "l?  '^T'r  ^  inf«nmtion  and  ideSs  thai,  students  who  were 
Ehlffion  St?  elaborations.  This  hypothesis  was  supported  by  the  main  effect  on  the  Visual 

Plractice  as  an  instructional  activity  has  a  long  history  of  support  Previous  research  with  thi« 

xSh^ZLnri^^^^  ^f^^^-  ^  fact,  under  those  conditions  practice  can  be  countaproductive. 
When  practice  requinng  significant  mental  investtnent  was  required  by  the  students  aStySvcn  the 

l*f        ^"^^    ^     Ricberlnd  Haimafin  (1988)  snSy  stoS 
sM^tS^tS?Si?lS  of  cogm^e  ovjload  which  lowered  posttest  lirfoniance^  S 

^^^^^iS"  ^»«!«,P«2T^e  decreases  as  the  amount  of  arousal  suipasses  an 
SSS  •     ^  maintained  tha^  student  perceptions  of  the  amount  of  menol  effort 

ISSTfi^?  *  "^f^^  ^'^^ ^ents  who  incorrecUy  perceive  material 

Z^J^iS^^'u^"^'^-^^'^^''^^y°''^^y-  Conversely.  students^SwpaSi^ 
matenal  as  too  difficult  are  unwilling,  or  see  themselves  as  unable,  to  learn.  IntcrestinelVwhen 
studcms  m  this  study  were  asked  their  perceptions  of  the  ease  or  dtfficiS^ofXteSK 

Sr^d'SlSS  t"v       ^^^l^  °"     ^^•^  ^here  one  i^S 'Jv^^/' aSd  five 

.hf  c  J?^/^"""^*  ^  irrespective  of  the  treatment  condition.  This  perception  is  clearly  k  conttaw  with 
the  studente'  apparent  experienced  difficulty  as  evidenced  by  the  iJ^SeS  scores  So^^rf^St 
^^^to'^StrS^'^l -ffi*^  V      "Pr?:«»y  have^ueSSi  tSe?^ptiot.Xy^l^/y 
S«^n?£5?Jf^?-^J?"j'^'''i^  accurately.  One  resulting  premise  fit)m  tfis  miW  be  that  die 
rcy  nabdity  of  mstiiiction  to  keep  students  on-task  in  meaningfiil  ways  is  increa^whS  student 
perceptions  abwt  the  amount  of  required  mental  effort  are  inaccurate        ""^^sea  ^nc"  stuaent 
r^.^  In  the  Rieber  (m  press)  study,  students  did  not  benefit  sigraficantiy  from  traditional 
post-questiomng  as  a  practice  technique.  In  the  present  study,  tfis  type  of  tSSSce  caUed 
Bdiavioral  Practice  again  did  not  produce  an  effect  Howe4.  acti^3ties  ScC^ff^^^ 

^^Zt  r^""^^  'a^^""-   P«^«Pa^in  a  simulation  requiring  ihS^to  SuSuSe 

Ac  science  concepts  and  prinaples.  appeared  to  be  effective.  The  CognSve  ftlcticr,  actiS^wore 
titough  to  promote  deeper  levels  of  mental  processing  (as  defined  by  Craik  ftuSS^T^zl) 
Stiidents  were  forced  to  actively  engage  in  the  proccs^  of  the  scieSe  mSenlllS  Akn  Sly 
smdying  die  content  This  is  consistc  ,t  widi  previous  research  which  indicates  thaT  ^ 
behayioraily-based  activities  are  more  effective  for  lower-level  Icamine.  whereas  coenitivelv-hased 
activities  are  more  effective  for  higher-level  learning  (daric.  IPS^KlSeSSn  tetS^the 
*^*SL°^t''*,y'°'^r^        cognitively-ba^  practice  activiticson  iSScJel  S 
supported  by  the  results  reported  here.  BoUi  practice  activities  seemed  to 

StL^S'??iSl^S?"'^       "^"^  '^.'P^'^  versus  No  ?SSccSSSs 

Students  m  Practice  groups  were  more  familiar  widi  using  and  applying  the  rules  ard  were  ina  better 

S^Kti?e'^ur™l£tt5'SSP^^*"'*'T*"^^^ 

the  pSttcst  '^"'^  ^       ^  ^  during 

Practicc^d  L?BeSS?^lw  ^'S^"  ^''y  P^"^^^  f«r  Cognitive 

mctice  and  not  Behavioral  Practice  (as  compared  to  No  Practice)  was  tiiat  Cognitive  Piactice  was 
probably  very  mtnnsically  motivating  for  students  of  this  age  level,  an  imSSStic 
maintaining  interest  and  keeping  students  on-task  longer  (Mal^'lPS^^^stSS^t^' 
encouraged  to  fantasize  about  being  the  pilot  of  a  slaiship  in  outer  space. 
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The  interaction  between  Visual  Elaboration  and  Practice  was  interesting.  An  intf,iaction 
between  these  two  factors  was  predicted  It  was  hypothesized  tiat  students  would  benefit  ftom 
pracQccactivitiw  naost  when  the  lesson  presentation  support  was  minimal.  Instead,  students 
OCTcnt^  most  from  the  animated  instruction  when  the  practice  support  was  moderate.  In  other 
wads,  the  animated  mstniction  provided  more  support  for  the  relatively  weak  behavioral  practice 
activity  than  for  the  cognitive  practice  activity.  However,  the  benefits  of  die  animated  insmiction 
woe  ehminated  witiiout  practice.  Students  did  not  benefit  from  Hat  behavioral  practice  unless  it  was 
used  in  tandon  with  die  animated  elaborations.  Animated  instruction  coupled  with  traditional 
questtomng  facilitated  results  similar  to  those  produced  by  the  Cognitive  Acti%ities.  It  may  have  been 
that  thcoocaaonal  questioning  encouraged  students  to  attend  more  closely  to  the  animated  visual  cues 
providpddmjg.the  lesson.  The  animated  elaborations  presented  witiiout  any  practice  support  were 
no  more  beneficial  than  either  static  graphics  or  no  graphics. 

9»»»ta«ti?g<m<fingconcermtitedegrt«  of  incidental  learning  resulting  to 
KSSSSl^^f  previously  indicated,  lesson  objective  six  tested  the  application  of  Newton's  second 

^TV"  ^"^^^  "ccdcration.  TOs  laws  explains  that  when 

JJ^tef^^^-^J'^'?^,"*  by  the  same  size  force,  the  initial  acceleration 

,  ,  ^  ^1        ^?  ™s  principle  was  never  diiectiy  taught,  but  was 

'^^^i"*  ^  '^'^  instruction.  One  animated  elaboration  illustrated  a  large  soM  box 

'  SSlJ^SlS;  '^'?  ^"^^  ^*  >^hich  had  just 

ESSlfiS^Fl*       baU  moving  quickly  acr««  the  screen.  No  attempt  was  made  to 
aSS^SISS?  f  ^  J?''  ^P"^       ^°^ly  *an  the  ball.  Students  rcceh^ng 

ZSSSi^fc?^        °"  tins  objective  atp=.09.  Students  seemed  to  be  attending  to  the 
Wropmte  details  of  the  animation  which  pertained  to  this  principle  although  they  were  not  ^ompted 

«m,ri«I?*  i?**^  ^      of  differentiation  between  the  lesson  conditions  are  not 

SSJf  niiSi^SflSi^^'**^  overridden  by  novelty  and  Hawtiiome  effects. 

»h?f^l2??^     opportunity  and  the  attention  received  which  resulted  fiom  th«r  participation  and 
this  seemed  to  cany  over  to  their  general  attitudes  about  computers,  science,  and  the  lesson 
in«m.  Ji,!!f!Sr2'     "^^^  °^  H?*  animation  can  se»ve  as  an  effective 

SSS?iv^^  ^r^fj-^"^  °^  animation  research,  die  efficacy  of  animation  is 

Si^iSnnKSSJf  "^"^^  ^       ^'^^  T  '^^'^  has  yet  to  be  proven  as  i  potent 
mstructional  vanable.  Previous  research  has  uidicated  Aat  students  do  not  always  attwd  to  the 
additional  visual  prompts  provided  by  animation  (Rieber.  in  press).  Given  proiJer  conations 
^^^^^.^  mfluence  student  achievotnent  These  conditions  incluSusing  animation  to 
SStn^i?^^  ^^""^  "u?^''"  trajectory,  lesson  material  which  is  wiequately 

^'  amiaation  in  tandem  with  other  suSortiv^ 

wiSJ^i/*'  "^^^  is         to  clarify  die  specific  nature  of  the 

unoacton  of  uumated  mstniction  and  practice.  More  infomiation  and  insight  is  Wded  to 

SS?f  th?SaS"^  instruction  could  be  expected  to  be  congruent  to  the 
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Table  1 

Mean  Percent  Scores  and  Standard  neviarinns  for  the  Posttftst 
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Pi^ce 


VlaUol 

Elaboration 

Behavioral 

Cognitive 

No  Practice 

Static  Graphic 

Mean 

44.6 

51.3 

51.3 

SD 

(30.5) 

(33.2) 

(33.1) 

n 

15 

12 

13 

Animated  Graphic 

Mean 

66.0 

61.6 

47.2 

SD 

(31.6) 

(34.7) 

(33.2) 

n 

11 

14 

14 

No  Graphic 

Mean 

44.9 

58.1 

45.3 

SD 

(32.6) 

(34.1) 

(30.4) 

n 

12 

14 

14 

Table  2 

ANQVA  .iimmarvTflhle 


Source 

DF 

MS 

F 

Probability 

(V)isual  Elaboration 

(P)ractice 

(V)(P) 

Error 

2 
2 
4 
660 

S662.42 
5423.62 
3985.85 
930.49 

6.09 
5.83 
4.28 

0.002* 
0.003* 
0.002* 

(L)esson  Objective 

(V)(L) 

(P)(L) 

(V)(P)(L) 

Error 

5 

10 
10 
iO 
660 

20338.72 
799.53 
1268.25 
667.39 
930.49 

21.86 
0.86 
1.36 
0.72 

0.0001* 
0.571 
0.193 
0.811 

*p<m 
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FLIGHT  SCHOOL- 


Practice  speeding  up  and  slowing  down  the  starship. 

USE  THESE  KEYS: 

and— ►     Spins  the  starship 

<SPACE  BAR>    Thrusts  the  starship  in  the 
direction  it's  pointing 


STATUS:  MOVING 


Left  Thrusts-6 


SPEEDsS 


Right  Thrusts=3 


computca-  screen  during  an  episode  of  Cognitive  Practice. 
inilS?^  under  shidcnt  controL  Arrow  keys  spin  the  starship  in  180  degree 

increments  resulting  in  one-dimensional  motion.)  f 


If  the  ball  was  kicked  two  times... 




...then  two  kicks  in  the  opposite  direction  would  be 
needed  to  stop  the  ball. 


READ  THIS  TWICE:  

When  an  object  at  rest  is  kicked,  an  EQUAL  kick  in  the 
OPPOSITE  direction  is  needed  to  stop  it  (when  there  is 
no  gravity  or  friction). 


Pr>88  <SPACE  BAR>  after  studying  .  .  . 


BfiUIfei.  Example  of  a  computer  screen  which  includes  a  static  visual  elaboration. 
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If  the  ball  wa$  kicked  two  times.. 


0  seconds 


H  the  ball  was  kkiced  two  times.. 


5  seconds 


If  the  ban  was  kicked  two  times.. 


...then  two  k\dk»  in  the  opposite  directbn  would  be 
needed  to  stop  the  ball. 


READ  THIS  TWICE:  

When  an  object  at  rest  is  kk:ked.  an  EQUAL  kick  in  the 
OPPOSITE  directton  is  needed  to  stop  it  (when  there  is 
no  gravity  or  friction). 


Pre—  <8PACE  BAR>  after  studying  ... 


12  seconds 


Fjwre  3-  Time-lapse  sequence  of  an  example  computer  screen  which  includes  an  animated 
visual  elaboration. 
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Behavioral    Cognitive  None 
Practice 

Figured  Interaction  between  Visual  Elaboration  and  Practice. 


Animation  and  Young  Children  IS 

Visual  Elaboration 

•  Static  Graphic 

•  Animated  Graphic 
A  No  Graphic 
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The  Effects  of  Computer  Animated  Lesson  Presentations  and  Cognitive  Practice  on 

Adult  Learning  in  Physical  Science 

•n.  c  u-     .  Abstract 

Hiepuipose  of  this  study  was  to  examine  the  effects  of  different  levels  of  visual  elaborations  and 
practice  on  appUcation  learning  of  adults  in  a  computer-based  science  lesson.  A  total  of  141 

^'Jif  P*««?I»te?  "» an  introductoiy  lesson  covering  Newtonian  mechanics.  Three 
S  5  ^^.F^^^  ^^'^  9?aphS.  Animated  Graphic.  No  Graphic)  were  crossed  with  three 
n!liS«„;^^  (Behavioral,  Cogmnve.  No  Graphic).  Behavioral  Ptactice  coa«sted  of  traditional 
qucstiomng  after  each  of  four  lesson  parts.  Cognitive  Practice  consisted  of  a  structured  simulation 
invohrmg  die  contn)l  of  an  animator  No  effects  were  found  for  Visual  Elaboration.  The 

aj^on  of  staoc  Md  animated  visuals  to  the  text  had  no  effect  on  teaming.  An  effect  was  found  for 
mctocc  such  that  both  types  of  practice  were  effective  (as  compared  to  a  control),  but  no  differences 
b^wen  *em  woe  detected  Main  effects  were  found  for  Visual  Elaboration  and  Practice  based  on 

latenqr  data  fiom  die  posttest.  A  moderately  significant  interaction  between  Visual 
Elaboration  and  Ptactice  indicated  several  trends  for  future  research. 

Introductim 

Since  the  introductiwi  of  microcoii5)uters  in  educational  settings,  a  great  variety  of 

r^h^J!?ljEESS?"'^''*^"P^",^-  Mostrecentdesignsofcomputer-basedinstniction 
{S,ai)  nave  attempted  to  create  uistructional  envuonments  which  integrate  wide  ranges  of  leamine 

JoiSS  ?        I  ^      instructional  design  (see  for  exai^le 

tLi  ?Ji   "^^^  *  *  MoiTison.  1988;  Tennyson  &  Christensen.  1988). 

S^SSf,£S?*^)L"^\''*:       suiprisingly  Utde  about  some  of  die  computer's  most  basi^ 
pcsentation  attnbutes.  Animadon  is  one  such  attribute  which  has  Uttle  empirical  support  aldiough  it 
is  widely  incoiporated  as  a  CBI  presentation  strategy  (Riebcr.  1989a).  aimougn 
fr^  *"PP*^  for  visual  presentations,  of  which  animation  is  a  subset,  comes 

from  scvOTl  inforaadon-proccsang  learning  dieories  (Gagnd.  1985).  Imagciy.  the  visualization  of 
S?^«rf?r  dimensions,  has  been  shown  to  be  particularly  uscfid  in  working  memory 

infomiation  (E.  Gagn6. 1985).  Whedier  imagery  is 
^inulT^a^^^  "      tcnn  memory  is  not  as  conclusive.  One  dieory  supporting  visuauSon's 
wihiv  J^^^T  dua^-codmg  hypotiiesis  (Paivio.  1979. 1983)  which  suggests  tfiat 

highly  unageabte.  concrete  uifonnadon  is  stored  botfi  verixdly  and  visually.  Retention  cm  be 
HlSfl!^?'*^'^?  activation  of  dual-coding.  When  infonnation  is 

aSSacSEi?Shi.^86?  "  ^  ^'^  ^  " 

nr^c^t^^l^^t^^u^J^^^      ^''^       '^P®^  investigating  die  effects  of  animation  as  a 
iStTn?  !'S?;**m'*'*  "^^"^  few  have  indicated  positive  resulte  (see*,  for  example.  SZdlo. 
1985.  King.  1975;  Moore.  Nawrocki.  &  Simutis,  1979;  Herd.  1985;  and  Rigney  &  Lutz.  1975) 

conrounding  in  some  of  diese  studies,  mate  generalization  difficult  Recendy.  Rieber  (1989b) 
Sr^iffil^n^'?  ?  "^^T  ^.^a^s  were  used  to  present  science  concepts  and  ndes  to 

Sf^Ir?^  ;  conditions  (eg.  animation  conj^ent  to  learning  task,  careful 

^  ^  "'^  of  optimally  difficult  materLl).  Related  res^KmS 
imagery  has  mdicated  nrnturadon  effects.  Older  students  consistendy  rely  less  on  external  images 

^^^^ZI^T  P«^°"«      °f  action  cff^lTSts 

r^baS  foSSSSy        "  ^  "appropriate  or  insufficient  resean:h  is  open  to  question  and  was 

•  ^  visualization,  animation  also  offers  die  attributes  of  motion  and  oajectnrv  to 

uistructional  prescntattons  (Klein.  1987).  Animated  visuals  should  be  expected  to  prornote  learning 
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when  motion  and  trajectory  attributes  am  congruent  to  the  learning  task  and  students  aie  unable  to 
mentally  amstruct  such  attributes  on  thdr  own  adequately.  Many  objectives  in  physics  instruction 
present  exan^iles  of  this.  Problems  in  teaching  physics  concepts  have  also  been  compounded  by 
many  Tmofts  of  student  misconceptions  of  the  physical  world  (diSessa,  1982). 

mctice  has  long  been  accq)ted  as  an  effective  learning  strategy.  Many  practice  strategies  are 
operationally  defined  as  asking  questions  before,  dining,  mi/or  b&ct  instruction  (Hamaker,  1986). 
Tliis  type  of  practice  tends  to  be  scxnewhat  behavioirJ  in  nature — enhancing  factual  and  ccxiceptual 
learning  tiiroug^  repetition.  While  tiiis  type  of  practice  is  effective  (see  for  example  Hannafin, 
Phillips,  Rieber  &  Garhart,  1987;  and  Hannafin,  Phillips,  &  Tripp,  1986),  especially  for  lower-level 
learning  outcomes,  it  trads  to  become  monotcmous  or  boring  far  die  student  and  relies  heavily  on 
extrinsic  motivatimL  In       this  t^ofpractice  has  been  conmionlyappUed  to  much  tutorial  an^ 
drill  and  practice  software. 

Practice  docs  not  have  to  be  limited  to  just  die  encoding  of  facts,  but  can  also  aid  higher-level 
cognitive  processing  (Salisbury,  1988;  Salisbury,  Richards,  &  Klein,  1985).  This  type  of  practice 
invdves  presenting  die  learner  witii  problems  or  conflicts  that  need  resolved  duou^  higher-level 
processing  such  as  informal  hypothesis-testing.  This  is  a  more  cognitive  approach  to  practice  design 
in  diat  it  provides  intrinsic  motivation  (MalcHie,  198 1)  for  students  to  become  involved  in  deeper 
levels  of  mental  processing.  CBI  affords  many  innovative  and  relatively  unique  practice  scenarios  to 
be  designed. 

The  purpose  of  this  sttidy  was  to  study  the  effects  of  animated  instruction  and  practice  on 
a^t  learning  in  science.  This  sftidy  was  a  replication  of  the  study  by  Rieber  (1989b)  which  found 
effects  of  animated  vilbals  on  children's  leanung.  In  tfiis  experiment  the  question  of  \**etfier 
animated  visuals  would  also  influence  adult  learning  or  if  adults  would  be  able  to  sufficiendy 
construct  such  images  internally  thus  making  the  addition  of  animated  visuals  unnecessary  was 
studied.  AdditionaUy,  the  role  of  varied  practive  activities  and  dieir  relationship  to  piesentation 
vanaUes  were  also  studied 

Methods 

Subjects 

The  subjects  consisted  of  141  upperclass  undeigraduate  students  (juniors  and  seniore).  All  of 
me  students  were  education  majors  cunendy  enrolled  in  an  introductory  computer  education  course. 
Participation  was  voluntary,  tiiough  extra  credit  in  the  enrolled  course  was  provided  as  an  incentive  to 
participate.  A  total  of  122  females  and  19  males  participated. 

CBI  Leawn  Content 

T*^  CBI  lesson  described  and  explained  Isaac  Ne^  The  lesson  was 

divided  mto  four  parts.  The  first  part  introduced  the  student  to  fundamental  background  vocabulary 
and  <^o-"^P»»  such  as  mass,  weight,  inertia,  force,  velocity,  and  acceleration.  This  pan  also  fomially 
presented  NewttMi*s  first  law  of  motion.  The  second  part  introduced  Newton's  second  law  of  motion 
and  men  descnbed  applications  of  Newton's  first  and  second  laws  given  equal  forces  in  opposite 
directums  m  onc-dim«isicMial  space.  The  tfurd  part  extended  the  application  of  Newton's  firet  and 
swond  laws  to  include  die  effects  of  unequal  forces  in  one-dimensional  space.  The  fourth  part 
introduced  and  explained  Newton's  third  law  and  applications  in  two-dimensicmal  space.  All 
J^^ction  was  presented  at  an  introductory  level  intended  for  novices.  The  lesson  was  designed  to 
exclude  as  much  formal  matiiematics  as  possible  and  instead  ccMicentratcd  on  concept  fonnaticn  and 
apphcauon.  Approximately  60  minutes  was  required  to  complete  the  lesson. 

Lesmn  Versions 

Ttaee  levels  of  Visual  Elaboration  (Static  Graphic,  Animated  Graphic,  No  Graphic)  were 
crossed  witfi  tfwee  levels  of  Fractice  (Behavioral,  Cognitive,  None).  The  respective  practice  activity 
was  provided  immediately  aftw  each  of  tfie  four  lesson  parts. 

^    Bchayioral  Pracrirfi>  This  consisted  of  five  multiple-chou:e  questions  presented  after  each  of 
the  Aour  lesson  parts  for  a  total  of  20  practice  questions.  The  questions  covered  tfie  application  of 
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infonnatwn  contained  in  each  respective  lesson  part  Informative  feedback  was  provided  to  tfw 
«udents  in  the  form  of  knowledge  of  correct  results.  This  condition  is  described  as  behavioral  due  to 
tne  leuiforcuijg  nature  of  the  practice  activity. 

.CggnitiYC  Pracrirff-  ntis  activity  consisted  of  a  structured  simulation.  Students  were  given 
inoteasing  levels  of  control  over  a  simulated,  free-floating  object  This  object  was  called  a  "storship" 
and  was  represented  by  a  triangular  symbol  on  the  computer  screen.  TTiis  practice  activity  is  an 
application  of  the  dynaturde  microworld"  developed  by  diSessa  (1982)  and  others  (White.  1984) 
iluspnictice  activity  is  an  example  of  a  'leaming-by-doing"  application  of  animation  (Brown,  1983). 
also  described  as  an  uitaacdve  dynamic  (Rieber.  1989a).  For  example,  students  practiced  increasing 
and  decreasuig  the  stership  s  speed  after  lesson  part  3  and  practiced  controlling  the  starship  when 
forces  are  applied  to  It  orthogonally  (in  90  degree  increnwnts)  in  part  4. 

NoPractlCfi.  This  level  acted  as  a  control.  No  practice  activity  was  given  to  these  students, 
instead,  tiiey  progressed  sequentiaUy  through  the  four  lesson  parts. 

Each  of  the  tttree  levels  of  Practice  was  crossed  with  three  levels  of  Visual  Elaboiarion  (Static 
Giaphi^Anmiated  Graphic.  No  Graphic).  Visual  elaborations  were  added  to  an  aU-text  lesson 
sOTpt  These  visual  elaborations  were  added  at  regular  intervals  at  locations  in  the  text  where 
pamculffl-  rules  and  apphcations  of  one  or  more  rules  were  being  explained. 

Stanc  firaphifr.  The  textual  presentation  of  the  science  instruction  was  supplementtd  by  static 
SEPf  n  Srapl^cs  provided  static  iUustrations  of  the  science  content.  Forces  were  represented 
SS^^ii^*      ^J/^  a  ball)  a  kick.  Motion  and  trajectory  attributes\rere 

represented  by  arrows  and  dotted  path  lines. 

Animagi  rrraBhiC-  in  this  condition,  each  static  graphic  was  replaced  with  an  animated 

howcvw.  the  ball  was  additionally  animated  to  demonstrate  the  consequences  (in  terms  of  speed  ^ 
!5Cf?2f^  2"n  ^  example,  a  stationary  ball  was  shown  being  kicked  two  timwto  the 

?Sl  Ji!  ^T^JT^  to  the  light  and  then  stopped  by  two  kicks  to  the  left 

Ttasdemonsirated  the  principle  diat  an  equal  force  in  tlTopposite  diiSis  needed  to^  flTc 

NgGrapjlig-  This  level  acted  as  a  control.  No  visual  support  was  ad/'xd  to  the  textual 
StSSr  "  textual  material  was  vertxitim  to  die  other  two  Visual  Elaboration 

Dependent  Measures 

Uo«,i„if!E^^°^!S^  TTie  posttest  originaUy  consisted  of  32  questions  measuring  application 
teaming  correspondmg  rougjly  to  rule-learning  as  defined  by  Gagn6  (1985).  Howevw.  13  questions 
T^J^^Tl?^  ''"^^'^  ^  «°  ^      of  dis(iiminiation  oAtyS 

!Sf«i  V  ?»"°^-"P  »tem  analyses.  Hie  remaining  19  questions  were  used  in  the  final  analysis. 
nSSS^^SfS,?!!!!?""'  '^J  distractors)  were  used  as  the  testing  format  The  pbsttest 

measured  student  perforaiance  on  the  foUowing  six  lesson  objectives: 

1)  apply  the  nile  tiiat  without  any  outside  forces,  an  object  in  motion  will  remain  in 
modon  and  an  object  a  rest  will  renaain  at  rest  (Newton's  first '  iw); 

2)  apply  uie  rule  that,  in  one-dimensional  space,  when  an  object  at  rest  is  put  into 

^  *  *PP^"*       opposite  direction  is  needed  to  stop 

tiic  object^ 

3)  apply  tiw  rule  that  in  one-dimmsional  space,  when  an  object  is  acted  on  by 
unequal  forces,  tiie  final  speed  and  trajectory  of  the  object  is  the  result  of  the  sum 
of  the  forces  acting  on  the  object  fiom  boUi  sides; 

4)  apply  the  rule  tfiat  in  two-dimensional  space,  forces  occurring  at  right  angles  to 
each  other  act  uidependently  on  the  object  (orthogonality); 

5)  apply  Newton's  second  law.  summarized  by  the  equation  forcc=mass  times 
acceleration  (Fsma);  and 

6)  apply  the  principle  of  die  relationship  between  acceleration  and  velocity. 
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TJc  foimat  of  these  questions  was  approximately  half  all-verbal  and  half  verbal/visual  and 
about  halfof  the  verbal/visual  questions  involved  animation.  No  feedback  was  provided  after  each 
question,  but  students  were  given  dieir  total  number  of  concct  and  wrong  responses  at  the  conclusion 
of  ttie  posttesL  KR-20  reliability  of  the  original  32  questions  was  .7 1. 

RfiSpaiKliirniry.  The  time  required  by  students  to  answer  each  posttest  question  was 
measured  to  the  nearest  second.  Respwisc  latency  was  measured  as  die  time  required  by  students  to 
answer  each  of  die  posttest  questions  once  pron^ted  to  do  so.  The  prompt  was  the  final  text 
displayed  on  die  screen  for  each  question. 

Wfltettklflg.  StudentswoeprovidcdpaperfiM-any  notes  tiiey  wished  to  take  during  tiie 
lessai  presoitation.  These  notes  were  analyzed  in  tenns  of  content,  style,  quality,  and  quantity  in 
relation  to  Die  lesson  presentation  in  which  diey  participated. 

I^jCSSnn  iSliryfty.  Upon  completion  of  die  lesson,  students  completed  a  post-lesson 
^^^l   ^"^^  *°  respond  to  open-ended  questions  which  addressed  issues  such  as  the 

difficulty  of  die  lesson,  how  die  lesson  might  have  hindered  dieir  learning  of  die  material,  and  how 
the  lesson  might  have  helped  dieir  learning  of  die  material.  The  students  comments  were  summarized 
wiui  reflect  to  dw  c(»tent  and  specific  examples  cited 

Procedures 

All  instruction  and  testing  was  administered  by  conaputer.  Subjects  were  randomly  assigned 
to  one  of  die  treatment  groups  as  diey  reported  to  die  lab.  Before  beginn'  ig  die  lesson,  aU  students 
were  pwn  a  group  orientation  to  die  lesson.  All  subjects  were  supplied  widi  paper  and  asked  diat  it 
be  used  for  any  notetaking.  AU  notes  were  coUected  by  die  proctor  at  die  end  of  die  experiment 
once  mstructed  to  bcgm,  students  completed  die  computer  lesson  individually.  The  posttest  was 
automatically  admuiistered  to  each  student  upon  completion  of  die  four  lesson  parts.  Immediately 
upon  completion,  students  were  informed  of  dieir  posttest  score.  Students  were  dien  asked  to  answer 
tne  post-lesson  survey.  Approximately  one  hour  was  needed  to  complete  die  lesson. 

Design  and  Data  Analysis 

n,  ,  ^  ^  ^^S^l  factorial  design  was  used  in  diis  study.  Two  between-subjects  fectors  (Visual 

wwwratKMi,  Pitacnce)  were  crossed  widi  one  widiin-subjects  factor  (Learning  Objective).  The 
tejivten-subjects  factors  consisted  of  diree  levels  of  Visual  Elaboration  (Static  Graphic,  Animated 
Graphic,  No  Graphic)  and  dnee  levels  of  Practice  (Behavioral,  Cognitive,  No  Practice).  The 
wittan-subiecte  factor  consisted  of  die  six  learning  objectives  which  also  served  as  a  dependent 
naeasure^tatistical  procedures  included  mixed-effects  analysis  of  variance  (ANOVA)  and  Tukey's 
sniaentized  range  test  for  follow-up  multiple-comparisons  on  means.  In  addition,  a  separate  analysis 
was  conducted  on  die  response  latency  data  from  die  posttest 

Besides  die  quantitative  measures,  qualitative  data  in  die  form  of  student  notetaking  arid 
post-lesson  surveys  were  also  also  analyzed. 

Results 

Posttest 

Tu  A  x55^"*  standard  deviations  of  student  posttest  scores  are  contained  in  Table  1. 

S^LZr    J!T^9^  table  is  contained  in  Table  2.  No  main  effects  were  found  for  Visual 
Elaboration,  F(2,660)=1.62,/»=.199.  Students  performed  similarly  on  die  posttest  regaixiless  of 
presentation  strategy. 

A  significant  main  effect  was  found  for  Practice,  F(2,660)=12. 19,  />=.0001 .  Follov.-up 
analyses  showed  dwt  students  in  die  Cognitive  Ractice  group  (raean=76.4%)  and  Behavioral  Practice 
goup  (TOan=8U%)  bodi  outperformed  students  in  die  no  practice  control  group  (mean=69.2%). 
ISO  significant  difference  was  indicated  between  die  Cognitive  and  Behavioral  Practice  groups. 
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Insert  Table  1  About  Here 


Insert  Table  2  About  Here 


A  significant  main  effect  was  found  for  Learning  Objective,  F(5,660)=3.37,  p=.005.  As 
expected,  learning  was  not  uniform  across  all  of  die  lesstm  objectives.  The  follow-up  analysis 
uidicated  a  significant  difiierence  between  posttest  scores  on  objectives  2  (mean=80. 1%)  and  3 
(mean=81.4%)  and  objective  6  (mcan=70.1%).  It  was  expected  tiiat  students  would  find  die  final 
objective  involving  acceleration  and  velocity  problems  the  most  difficult 

A  moderately  significant  difference  was  detected  between  Visual  Elaboration  and  Practice, 
r  (4,660)=2. 19,  p=,06%.  The  nature  of  this  interaction  is  shown  in  Figure  1.  TWs  interaction 
suggested  two  trends  in  the  data.  First,  die  Static  Visual  and  No  Visual  groups  appeared  to  be 
infltienced  toon  by  practice  tiian  die  animated  visual  group.  That  is,  when  practice  was  not  provided, 
die  Animated  Visual  group  ouQ)erfDrmed  die  otiier  two  visual  groups.  Second,  it  appeared  diat 
CQgmtive  practice  caused  interference  when  dw  lesiscm  was  presented  using  animated  visuals. 


Insert  Figure  1  About  Here 


ERIC 


Response  Latency 

A  main  effect  was  found  for  Visual  Elaboration,  F(2,660)=4.89,p=.008.  Students  in  die 
Animated  Graphic  condition  (nican=18  seconds)  took  signi5candy  less  time  to  answer  posttest 
questions  dian  eidier  students  in  die  Static  Graphic  (mean=20  seconds)  or  No  Graphic  (mean=20 
s  ^nds)  conditions. 

A  main  effect  was  found  for  Practice,  F(2,660)=22.57,p=.0001.  All  tfiree  practice 
conditions  were  significandy  different  fiom  one  anodier.  Students  in  die  Cognitive  Practice  condition 
gnean=17  seconds)  took  significandy  less  time  to  answer  die  posttest  questions  dian  diosc  in  die 
Behavioral  Practice  craidition  (mean=19  seconds).  Sdidents  in  diese  two  conditions  took 
significandy  less  time  to  answer  posttest  questions  d«an  sdidents  in  die  No  Practice  (mean=22 
seconds)  condition. 

A  main  effect  was  also  found  for  Lesson  Objective,  F(2,660)=50.51,p=.000l.  Three 
distinct  ranges  of  response  latency  among  die  lesson  objectives  grouped  die  objectives  as  follows:  die 
first  group  comprised  objective  5  (means26  seconds);  die  second  group  comprised  objectives  1 
(mcan=22  seconds),  4  (naean=21  seconds),  and  6  (mean=20  seconds);  and  die  diini  group  comprised 
objectives  2  (mean=15  seconds)  and  3  (mean=12  seconds).  All  diree  groups  were  significandy 
different  from  each  odier.  r  o-  / 
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Note  Taking 

»A.v^  %li*f  5^**^  Students  were  peitnitted.  although  not  prompted,  to  take  any  notes  they 
iJlTi  staden%  82  students  (evenly  distributed  across  all  presentation  fonnats)  fiUed 

^^'^^"^      no  notes  as  all.  TTie  types  of  notes  were 
^SS;  *^LfT'  J!S  ^^"^^  information,  foimu^as.  and  statements  of  £e  laws  of  motion. 
cSr5  canments  or  interpretations  of  the  infomation.  Twenty-six 

students  included  diagrams  reflectuig  solutions  to  some  of  the  questions  on  die  posttest. 

Post-Uason  Survey 

^  ^  ^,'?P°n*.  ^  consider  which  attributes  of  tiie  lesson  aided  their  learning,  all  groups 
^T^SlS Z*'^*'''  'PP^'ion.  self  pacing,  and  examples  provided  die  greatest  amount  of  help.  In 
recognized  general  lesson  design  features  as  aids  to  learning.  Students  in  the  Static 
OraphwconAoOT  specifically  mentioned  that  the  graphic  displays  were  helpful,  while  students  in  the 
Animated  Graptac  conchtion  mention^  diat  die  animation  and  motion  were  helpful.  Students  in  the 
No  Graguc  condition  cited  die  lesson  examples  as  being  helpful. 

n„*cri«^?i*^  ?  s^'^cn*?  in  *e  Behavioral  Practice  condition  specified  the  practice 

f  ^"^^  ''*^2^£'  '"•^^  ^  ^  Cognitive  Practia  condition  referred 

i^ttS^affi^dSSSStT' ^    ^•^^p^^-  ^^^"^  ^  ^° 

5nf«r«,o?I!!f!L2^^'^*  hindered  tfieir  learning,  all  groups  mentioned  die  amount  of 

iw^S^S^*?**"^  ^""^^        ^'"^  "»oo  much".  A  second  concern  was  not  being 

^'^Scw^iJ^^'r^^''  •°i!rt''  interesting  to  note  diat  students  in  the 

menaoned  diat  die  "rolling  baUs"  took  too  long,  while  students  in  die 
n^.^^T^T^'^y  mentioned  tiiat  examples  of  a  moving  £u  and  kicks  were 

n"S^aS^woddI^iL^^^  ^"^^  S-P»'- 

r«on4rii!?i!!!l*^°^  ^'^^^        ^  not  mention  any  specific  concerns,  but  students  in  die 
SS^  sSiSS.^^.*S;T"*  *y  ^*"8*y'  specifically  in  die  practice  activities. 

JJ^ildSX  pSS.  °"  "^"^  ^'"^  not  completely 

General  Discussion 

used  i«  was  to  investigate  whedier  previously  indicated  effects  of  animation 

nSrfS^RSlf^?!^     P^"?  °n  children's  learning  of  certain  science  material 

SfSS;„!5?^  ^"^^    replicated  using  adults.  The  science  materia  taught  Newton's  dSce  tews 
?n.2S?^  ^^'^         for  Its  conceptual  density  and  its  obvious  congruency  wkh  SiinSS 
JSS^^STl";'*^''  'TS  *^  J^*"**  ""^terial  widi  young  children  has  indicatSSmation 

^J^Sf??^'  but  only  under  certain  conditions.  For  exjunple;  in  die  Riebcr  (1989b)  snTdT 
S^^r^f^^u'^'^  presentation  strategies^y  WTdie  Snftask  t« 

^"^y  P^P^  »o  attend  to  die  animation.  cSier  ^nation 
SSIJS  ^l^i^^  ^^^^^^     ^^^y  '"P*^  no  significant  differences.  However,  general 
SSSf]*  n^^^tion  effects  (Piccssley,  1977)  where  an  individual's  de^^iSaice  on 

SSiSJffif  r'P''  '"/^  ^*  «n  attempt  to  validate  empiricaUy 

5ft?SSr'!5l?„  ^Sr"^  of  animation  and  maturation  using  material  found  to  produce  an 
^S^sSlr  ^  """^"^  and  concept  density)  toScrtiic 

were  nJEki£c^S?v^t£'tJ^""}  Elaboration  were  found  in  diis  study.  Adult  subjects  in  diis  study 
^hTeS  .^i       by  d«  t)mc  of  presentation  strategy  used.  The  vertwU  material  was  presented  to 
5SSJ5?SffSf,??*^'  explanations  ard  examples.  Although  subjects  found  the  lessaa 
^Tf^  difficult  (overall  mean  =  75.6%)  such  diat  ceiling  effects  can  be  excluded,  uic 
^S^u1^wSf'^^?"l'  »o  Provide  more  concrete  elaborations  of  die  veriial  iS^al  did 
?Sru?resSShaK^^^  '^""^     '''^'^  P^^"^^*^  ^^'^Sies  5  s  consistent  wid, 
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It  IS  contended  that  successfully  performing  the  task  requirements  of  this  lesson  required 
subjects  to  pCTfonn  three  imaging  functions:  1)  adequate  visualization  of  the  physical  science 
matmal;  2)  adequate  and  accurate  imaging  of  differences  in  the  motion  of  objects  (i.e.  moving,  not 
movuig,  changes  in  speed);  and  3)  adequate  and  accurate  imaging  of  the  trajectory  of  objects  (i  e 
direction  of  the  path  of  the  moving  object).  The  verbal  presentation  of  the  lesson  material  was 
dcagried  to  act  as  a  stand-alone  presentation  vehicle.  It  sufficientiy  provided  aU  infoitnation  by  way 
of  highly  unagMble  explanations  and  examples  as  w  It  was 

bebcved  that  this  design  wouW  support  individuals  capable  of  internally  imaging  these  three 
functions.  Students  given  an  aU-verbal  presentation  would  be  required  to  form  internal  mental 
images.  Static  and  animated  visual  elaborations  of  the  verbal  infonnation  were  then  added  to 
successively  provide  more  concrete,  fixiBllial  imaging  devices.  In  diis  studv,  subjects  provided  with 
these  external  unaging  devices  performed  as  well  as  subjects  who  were  given  an  all-verbal 
presentation.  ^ 

The  response  latency  data  indicates  that  although  animation  did  not  affect  learning,  it  helped  to 
decrease  the  time  necesssaiy  to  retrieve  infonnation  from  long-teim  memory  and  then  subsequently 
reconstruct  It  ui  short-tam  memory.  TTiis  retrieval  process  required  students  to  reconstructmental 
masfis.  The  animated  visual  presentation  significantly  aided  the  students  in  this  mental  visualization 
effort  as  compared  to  students  m  the  static  or  no  visual  conditions.  Comments  on  the  survey  from 
students  ui  the  visual  groups  that  visuals  helped  them  as  weU  as  comments  fiom  students  in  the  No 
Visual  group  that  visuals  wouM  have  helped  supports  diis  contention. 

Practice  has  a  long  history  of  support  as  an  instructional  activity.  Not  only  is  its  use 
uitoinvely  obvious,  but  is  weU  supported  in  instructional  design  theory  (Gagn<,  1985).  Operational 
definitions  of  instructional  practice  often  turn  out  to  be  forms  of  questioning,  largely  a  result  of  the 
pioneering  woric  of  Rothkopf  (1966).  However,  advances  in  cognitive  psychology  coupled  with 
mstructional  opportunities  available  with  computer  technology  present  many  interesting  practice 
activities  not  yet  suffiaentiy  tested  or  validated.  In  this  study,  two  practice  conditions  were  tested. 
Tl»  Behavioral  Piractice  group  received  a  traditional  questioning  activity,  whereas  die  Cognitive 
nacttcc  group  partiapated  m  a  structured  simulation  uivolving  the  control  of  an  animated-'starship" 
uia  mctionlcss/gravity-fiee  envuonmenL  Both  practice  groups  significandy  outperfonned  the  No 
Practice  control  j^p.  However,  no  significant  differences  were  fbund  ^tween  die  practice  eroups 
one  conclusion  of  no  great  surprise  is  diat  interactivity  of  any  sort  aids  learning  more  tiian  no 
interactivity.  However,  it  was  expected  diat  die  cognitive  activity  wouW  promote  higher-level 
T^Ua^C^     bdiaviorally-based  questioning  approach.  Several  researchers  have  discussed 
die  benefit  of  behavioral  designs  m  promoting  lower-level  learning  and  cognitive  designs  for 
^^:^^'^\}^^SiC^im).  In  diis  study,  bodi  practice  types  were^equally  effective.  TOs 
cadd  have  been  caused  by  die  fact  diat  die  questions  sufficientiy  required  stadents  to  process  dw 
mformation  at  deeper  levels  of  processing  or  because  students  were  not  given  enough  time  and 
expenence  witii  die  cogmtive  activities  to  produce  a  differentiated  effect  At  die  venr  least  die 
suructured  sunulation  activity  has  been  partially  vaMdated  as  an  innovative  instructional  activity  shown 
<»i  be  as  effective  as  more  conventional  practice  activities. 

The  response  latency  data  supports  die  contention  dint  bodi  practice  conditions  faciUtated 
students  oripnization  of  die  material  and  dieir  understand^ig  of  die  relationship  among  die  many 
concepts  and  rules.  Even  diough  no  differences  in  learning  was  indicated  between  die  two  practice 
noups,  Ae  CognmwPractice  group  took  even  significandy  less  time  to  answer  postt-jst  questions 
flian  die  Behavioral  Practice  group.  TTus  provkies  partial  evidence  of  die  fact  diat  diis  grtwp  may 

,t Ji^^SS^^ SSS™**^**"  "  by  Craik  &  Lockhart,  1972)  dikn  students 

ui  the  Behavioral  Practice  group.  Comments  fiom  students  in  die  No  Practice  group  accurately 
reflected  dieir  lack  ofprqiarcdness  for  die  posttest  F»^u«iwiy 

The  moderately  significant  interaction  between  Visual  Elaboration  and  Practice  was 
intCTCsttng.  Two  tiiends  were  indicated.  The  first  tiend  seemed  to  indicate  diat  die  Static  Visual  and 
No  Vwual  groups  were  mfluenced  more  by  practice  (Behavioral  and  Cognitive)  dian  die  Animated 
Visual  group.  In  odier  words,  students  appeared  to  benefit  most  fiom  die  practice  activities  when  die 
S^SIIjS!^?**^**!* "PP?"  was  minimal.  The  second  trend  seemed  to  indicate  diat  some  interference 
occurred  between  die  amraated  lesson  presentations  and  die  cognitive  practice  activities.  Reasons  for 
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^S^SSSSS^^JS^^ y*'^  Reseaichindicatesthatchildrcnandadultshavcmany 
S^SK^liSSS^  "^^^l P^ciP^es  (Champagne,  Klopfcr.  &  Gunstonc.  1982;  diSessa. 
miu.^^tS^^A'^f  are  based  in  part  on  each  individual's  personal  theories  of  the  physical 

?hv  JTifJSl^tSS"''''*  condition  paired  with  precise  animated  presentatioKs  of  the 

jiiSSlrcE^^^  Since  this 

h^^^i^t!^Z°,:^^l^^  """^  insttfficient  time  and  e«)crien<Se  with  the  material  to 
rSl^!^^  "7°^  ?  reconcile  the  inconsistencies  between  scicntifereality  and  Acir 
misconceived  "Rahty".  hence,  the  students'  learning  of  the  mat^  was  interf^ 

„„™.  JT°^*J5!.r^^  ^  ^  **^y  "^^'te  *at  inclusion  of  animated  instruction  may  be 
KSffif^,  JK^^S*^^        "f  »°  P«>vidc  Suit  sS 

SSSf5SS^^5S2^"*K"^  effectively  pioiipt  these  students  to  fomi 

S^SkSfS  "^^h^**  that  there  aiJ  conditions  under  which 

S^ZS^!f  ^^Tl*  for  prescntaapn  Duiposes.  such  as  occasionaUy  with  young 
SSJSS^S^.^?^         ^.^i«P^ted  ^  adults.  However,  the  icsponse  hitency  data  indicated 

SJ,5fJS^!S?*'2''^l?^'^.^^^  thus  aiding  lemdng 

Successful  applications  of  animated  visuals  with  adult  pqpSons  have  been  reported  whcnSe 

J^fTL"^  an  intenum\c  djoiamic  (Collins.  XSns.  &  Pew.  im^^l^,  ^tc, 
cSli  ^  mteracdve  dynamic  was  used  as  p  cognitive  practice  wtivitv  and  wak 

pSSTiS^t^^SCl?      *««iv«y  .^^^  animation's  mle  when  usH  ^ 

SSLSris^SSto^XSwiIt^l?^^^^^^  More 

n^SS?  ffij^  arohcations  of  the  conditions  under  which  interactive  dynamics  arc 

ji?^*^*^i^y'?*'*»S?»«edinteractionbetweenanimatedprc^ 
^rSSS  PO  Aintciferenct  to  learning  needs  mo^clarification 

d«a«,  .iS^^S?*        "^^^  *^8neis  should  be  encouraged  to  conSuc  to 

2Sf?„?^     innovative  mteBCtive  dynamics  as  it  appears  that  the  time  necessary  to  dcskn 

^tSSfthTS^^ZS'^S^-,  ^ "^"^  aniimtrfSnate can p^^tS^eSvely 
S£!Sir™!^H^**^^f^        presentations,  with  and  without  static  graphics,  which 

^ter^JlnlSS'cdS?^"!!^^^^  2""^ More leSfs nSSin other 

content  areas  and  mstrucdonal  situations  in  order  to  determine  the  boundaries  of  these  effects. 
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Visual 
Elaboradon 

isenavionu 

Cognitive 

None 

Static  Graphic 

Mean 

SD 

n 

80.5 
(28.3) 
16 

77.3 
(32.0) 
16 

64.0 
(36.6) 
16 

Animated  Graphic 

Mean 

SD 

n 

81.6 
(26.9) 
15 

70.2 
(33.7) 
15 

72.3 
(35.5) 
15 

No  Graphic 

Mean 

SD 

n 

81.2 
(30.2) 
16 

81.4 
(28.7) 
16 

71.5 
(33.1) 
16 

Table  2 
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(V)isiial  Elaboration 

(P)ractice 

(V)(P) 

Error 

2 

2 
4 
660 

1337.45 
10073.25 
1813.02 
826.39 

1.62 
12.19 
2.19 

0.199 

0.0001* 

0.068 

(L)esson  CMijective 

(V)(L) 

(P)(L) 

(V)(P)(L) 

Error 

5 
10 
10 
20 
660 

2782.82 
1051.05 
771.01 
764.02 
826.39 

3.37 
1.27 
0.93 
0.92 

0.005* 
0.243 
0.502 
0.556 

'p<.01   
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Coitputer  Access  and  Flowcharting  as  Variables 
in  Learning  Computer  Prograitming 


Research  on  pre-college  programming  instruction  has  often  yielded 
disappointing  results.    After  completing  such  courses,  students  frequently 
exhibit  fundamental  misconceptions  and  poor  problem-solving  strategies 
(Dalbey,  Toprnaire,  &  Linn,  1986) .    These  outcomes  suggest  that  traditional 
methods  of  teaching  programming  in  secondary  schools  may  need  to  be 
reoriented  to  better  accoitinodate  environments  that  often  differ  substantially 
from  college  classes.    One  interest  of  the  present  study  concerns  the 
provision  of  unlimited  access  to  computers  in  programming  classes.    Wiile  the 
importance  of  computer  access  is  intuitively  apparent,  the  notion  has  not 
been  thoroughly  researched.    On  the  one  hand,  it  would  seem  that  on-line 
practice  can  promote  discovery  of  design  principles  and  prcicedures  (Bayman  & 
Mayer,  1983) .    On  the  other  hand,  the  novice's  "rush  to  the  ccnputer"  may  be 
associated  with  little  program  planning  and  consequently  poor  techniques  and 
conceptual  understanding  (Mayer,  1979;  Pea  &  Kurland,  1983;  Dalby  et  al., 
1986) .    Prom  the  latter  perspective,  limited  computer  access  might  engage 
students  to  a  greater  extent  in  planning  activities,  and  thus  engender  more 
systematic  problem-solving  approaches  than  would  occur  with  unlimited  access. 

The  above  rationale  raises  the  additional  question  of  whether  planning 
activities  can  be  facilitated  by  using  flowcharts  to  specify  the  program 
logic  and  structure  prior  to  writing  code.    Research  on  the  benefits  of 
flowtSjarting,  however,  has  been  inconclusive  (Glorfeld  &  Palko,  1984; 
Schneiderman  et  al.,  1982;  Brook  &  Duncan,  1982).    Accordingly,  as  an 
extension  of  this  earlier  work,  the  present  study  crossed  the  manipulation  of 
flowdiarting  with  in-class  coraputer  access,  thus  examining  flowcharting 
effects  in  (a)  the  traditional  lecture/laboratory  setting  and  (b)  a  classroom 
setting  replacing  on-line  time  with  manual  simulation.    A  reasonable 
assumption  is  that  when  compu*-er  access  is  not  an  immediate  option,  students 
will  use  flowcharting  more  effectively  as  a  design  strategy.    A  supplementary 
question  concerned  whether  gender  differences  in  prograwning  performance 
would  occur  under  the  different  flowcharting  and  coitputer  access  conditions. 
Previous  results  suggest  that  females  generally  perform  as  well  as  males  at 
learning  to  program  (Madinach  &  Corno,  1935;  and  numerous  others) ,  but  it 
could  be  that  different  attitudes  and  learning  strategies  (Lockheed,  1985) 
predispose  one  group  to  adapt  better  in  less  structured  (e.g.,  no  flow 
diagram;  unlimited  access)  settings,  and  vice  versa. 

Method 

Sample  and  Design 

Subjects  were  24  male  and  48  female  high  school  students  enrolled  in 
four  sections  of  a  conputer  literacy  course  taught  by  the  second  author.  All 
had  completed  12  weeks  of  the  18-week  course,  but  had  not  yet  received  any 
programming  instruction.    They  were  assigned  at  random  to  four  treatment 
groups  arranged  by  crossing  the  computer  access  variable  (unlimited  vs. 
limited)  with  flowcharting  (required  vs.  not  required) . 

Initial  analysis  used  a  2  (computer  access)  x  2  (flowcharting)  x  2 
(gender)  MANOVA  with  dependent  variables  consisting  of  error  recognition, 
interpretation,  programming  templates,  mental  models,  progranming  problan, 
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flowchart  score^  progranining  attitude^  and  flowdiarting  attitude.  Subsequent 
analysis,  incorporating  prior  academic  achievement  as  a  variable,  consisted 
of  a  2  X  2  X  3  MANOVA  utilizing  computer  access,  flowcharting,  and  ability 
group  (high,  medium,  or  low)  as  independent  variables. 

Course  Curriculum  and  Materials 

Five  instructional  units  dealing  with  introductory  concepts  in  the  BASIC 
programming  language  were  presented  in  18  SOnminute  class  periods.    Unit  I 
dealt  with  operational  commands,  such  as  RUN,  LIST,  SAVE,  and  editing 
features.    Students  were  also  introduced  to  programming  terminology  and 
fundamental  concepts,  as  well  as  flowcharting  techniques.    Units  II  -  V 
presented  applications  using  programnning  statements  LET,  PRINT,  GOTO,  INPUT, 
and  IFAHEN.  The  posttests  described  below  were  administered  over  a  two-day 
period  iimiediately  following  the  completion  of  Unit  V. 

Achievement  posttest.    The  achievement  posttest  assessed  performance 
on  five  fundamental  progranining  skills  and  on  ability  to  utilize  flowdiarting 
as  a  progranining  aid. 

Subtest  I,  "Error  Recognition,"  presented  eight  short  groups  of 
progranining  code  which  contained  either  a  syntax  or  logic  error.  Studentfi 
were  asked  to  find  and  specify  the  cause  of  the  error.    Items  were  scored  as 
correct  (1)  or  incorrect  (0). 

Subtest  II,  "Interpretation,"  presented  students  with  four  short 
programs  and  required  them  to  identify  the  purpose  and  output  of  the  code* 
Students  were  scored  for  both  their  narrative  explanations  and  descriptions 
of  output  (1  for  correct,  0  for  ir^rrect) . 

Subtest  III,  "Progranining  Templates"  required  students  to  write  three 
short  segments  of  progranining  code  which  performed  a  fundamental  proceciure 
such  as  averaging,  counting,  or  evaluating  input.    Programs  were  scored  as 
correct  in  both  syntax  and  logic  (2),  correct  in  either  logic  or  syntax  (1), 
or  totally  incorrect  (0) . 

Subtest  IV,  "Mental  Models,"  was  desijnej  from  the  ;ork  of  Bayr/ian  (1983) 
to  assess  accuracy  of  students'  mental  txjdels  3f  statement  execution. 
Students  were  given  common  programming  stat^'nents  and  as';^-l  to  describe  in  a 
step-by-step  fashio..  exactly  what  happen>i  //hen  tne  st^t  --ent  executed. 
Explanations  ,vere  scored  as  correct  (2),  incov^-^te  (1),    -  incorrect  (0). 

Subtest  V,  "Progranining  Problem,"  presented  students  with  a  problem  for 
which  they  had  to  develop  a  program.    Students  first  designed  a  flowchart  and 
then  wrote  progranining  code.    Flowcharts  were  scored  as  correct  (3), 
'  icoraplete  (2) ,  incorrect  (1) ,  or  no  attempt  (0) .    Programming  score  was 
obtained  by  scoring  individually  five  routines  or  templates  required  by  the 
programming  problem  (input  routine;  evaluation  of  input;  use  of  summing 
variable;  combining  a  literal  string  and  a  variable  in  a  print  statement;  and 
recursion)  in  the  same  manner  as  Part  III  above  (2,  1,  or  0). 

In  scoring  the  posttest,  clear  rules  were  developed  and  strictly 
followed  to  ensure  objectivity.    Also,  identification  numbers,  rather  than 
names,  were  used  in  order  to  conceal  subjects'  identities  during  scoring. 
Internal  consistency  alpha's  ranged  from  .65  to  .86  for  all  measures. 
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Attitude  measure >    Following  the  posttest,  a  15-itan  attitude  survey 
was  adninistered. Students  were  asked  to  respond  to  such  statements  as 
•Programming  is  fun"  by  indicating  the  extent  to  which  (on  a  Likert  scale  of 
1  to  5)  they  agreed  with  the  item.    Statements  related  to  either  attitude 
toward  use  of  flowcharts  or  attitude  toward  prograimiing.    Ten  additional 
items  were  included  to  gather  information  on  students'  prior  progranroing 
experience,  out  of  class  catputer  access,  and  so  on. 

Procedure 

Students  in  these  classes  had  been  accustomed  to  sharing  a  conputer  with 
one  or  more  partners  during  the  prior  12  weeks  of  the  semester.    They  were 
told  that  for  this  progranining  unit,  a  new  method  of  conducting  the  class  was 
to  be  tried,  and  that  on-line  computer  time  and  classwork  requirements  would 
be  different  depending  on  the  instructional  group  in  which  they  were  placed. 
The  classes  were  quite  willing  to  cooperate  and,  after  the  first  few  days  of 
instruction,  there  was  never  a  need  to  discuss  the  different  methods  again. 

Treatment  began  on  Unit  II,  with  the  presentation  of  new  concepts  and 
statements  to  the  conbined  treatment  groups.    After  the  instructional  period, 
students  practiced  the  statements  that  had  been  presented  according  to 
assigned  treatment  procedures.    Students  in  the  unlimited-access  group  worked 
in  the  laboratory  section  of  the  classroom  where  a  catputer  was  assigned  to 
each  individual  to  use  as  he  or  she  desired.    Members  of  the  limited-access 
group  worked  at  their  desks  in  the  lecture  area  of  the  classroom.  These 
students  (ranging  in  number  fron  7  -  10)  shared  a  single  computer  for  testing 
their  code.   Working  with  partners  or  in  informal  groups  was  not  allowed, 
although  both  groups  were  allowed  to  discuss  problems  and  seek  help  from 
other  students  or  the  teacher.    It  was  expected  that  the  limited-access  groip 
would  be  more  responsive  to  interaction  with  the  teacher  than  the 
unlimited-access  group  and,  consequently,  might  receive  more  instruction  and 
attention.    To  control  for  this,  the  teaciier  did  not  initiate  contact  with 
either  group  and  responded  when  called  on  by  asking  a  leading  question  or 
making  a  suggestion  rather  than  supplying  the  answer. 

Half  of  the  students  in  each  of  the  access  groups  were  required  to 
submit  flowdiarts  with  their  assignments.    The  classes  were  introduced  to  the 
technique  of  flowcharting  as  an  instructional  design  aid  in  the  first 
programming  unit.    Flowcharting  was  initially  demonstrated  in  a 
non-programming  application  and  applied  to  programming  when  the  first 
statement  was  introduced.    One  class  period  was  devoted  to  instruction  in 
flowcharting  and  all  students  participated  in  exercises  involving  flowc4iar> 
creation.    The  teadier  continued  to  demonstrate  program  flow  using  flowcharts 
and  to  reconroend  them  for  program  design.    However,  only  those  students  in 
the  flowchart  groups  were  required  to  subnit  them  to  fulfill  their 
asrignments.    The  same  basic  procedures  were  followed  for  Units  III-IV. 
Following  Unit  V,  students  completed  the  achievement  posttest  followed  by  the 
attitude  survey. 
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Results 

D^ndent  variables  were  scores  on  the  five  programming  achievement 
subtests,  flowcharting  score,  flowcharting  attitude,  and  progranining 
attitude.    All  measures,  with  the  exception  of  progranming  attitude,  were 
significantly  interrelated  (Median  r  »  .55),  iitplying  the  use  of  multivariate 
analysis  of  variance  (MftNOVA)  to  decrease  the  risk  of  a  Type  I  error.  The 
basic  MANOVA  was  a  three-way  factorial  consisting  of  2(ccniputer  access)  x 
2 (flowcharting)  x  either  2 (gender)  or  3 (ability)  group.    A  regression 
solution  was  used  in  all  multivariate  and  univariate  two-factor  analyses  to 
control  possible  biases  caused  by  unequal  n's.    Initial  analyses  showed  no 
differences  on  cumulative  attitude  score  due  to  either  the  computer  access  or 
flowdiazting  variable. 

Gender  as  an  Individual  Difference  Variable 

Analyses  using  gender  as  a  grouping  variable  yielded  only  one 
significant  effect,  the  interaction  between  computer  access  and  gender  (  p  < 
.02).    Univariate  tests  of  the  interaction,  however,  were  significant  only  on 
mental  models  (  £  <  .03) :  females  perfonned  better  on  mental  models  in  the 
limited  access  group  (  M  »  53%  correct)  than  in  the  unlimited-access  group  ( 
M  «  34%);  no  differences  were  evidenced  for  males.    lu  general,  males  scored 
slightly  but  not  significantly  (  £  >  .05)  higher  than  fanales  on  the  various 
programming  subtests. 

Ability  as  an  Individual  Difference  Variable 

To  examine  the  ATI  involving  academic  ability,  students  were  ranked 
according  to  oinulative  grade  point  averages  and  were  divided  into  high, 
median,  and  low  groups  of  approximately  equal  numbers  based  on  those 
rankings.   As  would  be  expected,  the  ability  group  main  effect  was 
significant  in  the  MANOVA  (  £  <  .001)  and  in  all  univariate  tests  (high  > 
middle  >  low) .    More  revealing  was  the  significant  -"iltivariate 
ccraputer-aocess  by  ability  ATI  (  £  <  .01) ,  which  w     also  significant  in  all 
univariate  tests  except  for  programming  templates.    The  consistent  pattern 
was  for  the  low-ability  group  to  perform  better  under  unlimited-  than 
limited-computer  access,  whereas  the  c^posite  tendency  occurred  for  middle- 
and  high-ability  groups.    Follow-up  examination  of  the  five  ATIs  showed  that 
each  pattern  was  disordinal.    Specifically,  in  each  case,  the  unlimited 
access  mean  was  higher  than  the  limited  access  mean  for  low-achievers  (  p  < 
.05) ,  while  the  converse  pattern  occurred  for  middle-  and  high-achievers. 

The  MANOVA  also  yielded  a  significant  flowcharting  main  effect  (  p  < 
.05).    Univariate  tests  were  significant  for  mental  models  and  progranming 
problem.    However,  an  examination  of  group  means  indicated  that  the  effect 
was  not  in  the  direction  hypothesized.    Students  who  were  not  required  to 
submit  flowcharts  tended  to  score  higher  on  all  subtests  tEan  those  required 
to  submit  them.    On  mental  models,  the  no-flowchart  group  mean  was  1.13 
compared  to  the  flowchart-required  group  mean  of  .80;  on  the  progranming 
problan,  the  respective  means  were  1.08  and  .65. 

Discussion 

The  present  results  were  inconsistent  with  some  comnwn  assunptions 
regarding  the  influences  on  learning  programming  of  unlimited  in-class 
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computer  access,  flowcharting,  and  gender.  Accordingly,  different  ways  of 
conceptualizing  and  structuring  programming  instruction  at  the  precollege 
level  are  suggested.    First,  group  means  on  four  of  five  posttest  measures 
were  directionally  higher  for  the  limited-access  group  than  the 
unlimited-access  group.   While  it  is  clearly  helpful  to  achievanent  to  have 
sufficient  access  to  computers,  inposing  reasonable  limitations  on  computer 
access  may  encourage  students  to  give  greater  attention  to  program  design  and 
mental  execution  of  code.    This  overall  interpretation,  however,  was 
qualified  by  several  ATI  effects.    Females  performed  better  under  limited 
access,  while  males  showed  the  opposite  pattern.    One  possible  explanation 
concerns  females'  generally  lower  confidence  and  greater  anxiety  regarding 
computer  interactions  (Chen,  1986).    Thus,  a  greater  proportion  of  females 
than  males  may  have  found  it  more  comfortable  to  work  without  a  corputer. 
Given  that  this  effect  occurred  on  only  one  dependent  variable,  however,  its 
importance  should  be  questioned.   A  stronger  and  more  consistent  ATI  pattern 
was  for  low-ability  students  to  perform  better  with  unlimited  access,  and 
conversely  for  middle-  and  high-ability  students.    Low-ability  students,  it 
would  seem,  are  less  able  to  mentally  simulate  program  execution  and 
therefore  become  more  dependent  on  iitinediate  computer  feedback  and  concrete 
contextual  cues.    Higher-ability  students  are  better  prepared  to  benefit  from 
the  added  cognitive  demands  of  limited  access  and  to  use  the  increased 
planning  time  effectively. 

The  significant  flowcharting  effects  on  posttest  scores  indicated  that 
students  performed  better  when  not  required  to  submit  flowcharts.  One 
explanation  is  that  many  did  not  adequately  master  flowcharting  skills.  In 
fact,  on  a  follow-up  survey  65%  reported  understanding  it  "somewhat"  and  19% 
not  at  all."   Second,  seemingly  because  of  its  pictorial  orientation  and 
special  symbol  system,  rlowcharting  appeared  to  be  regarded  by  many  students 
as  an  entirely  separate  task,  rather  than  as  a  progranming  aid.  Perhaps, 
similar  to  how  sentence  diagramming  in  English  is  taught,  flowcharting  may  be 
more  beneficial  if  introduced  after  students  have  acquired  a  fundamental 
understanding  of  programming  processes.    It  is  also  revealing  that  over  65% 
of  the  flowchart  group  reported  creating  the  flowchart  after  having  written 
the  associated  programming  code.    These  negative  experiences  undoubtedly 
contributed  to  the  flowchart  group's  rating  of  progranming  as  "more 
frightening"  compared  to  the  no-flowchart  group.    Gender  was  net 
significantly  related  to  either  achievement  or  attitudes,    it  is  noteworthy, 
however,  that  in  this  elective  high  school  literacy  course,  taught  by  a 
female  instructor,  females  outnumbered  males  by  2:1,  a  direct  contrast  with 
typical  ratios  (Lockheed,  1985).    As  Linn  (1985)  has  noted,  the  main  problem 
for  female  students  has  traditionally  been  lack  of  participation,  not  of 
cibility,  in  programming  classes. 

The  above  results  suggest  three  major  considerations  for  the  teaching  of 
programming.    First,  unlimited  computer  access  may  be  less  important  than  is 
generally  assumed,  especially  for  middle-  and  high-achievers.    Teachers  might 
consider  encouraging  (or  requiring)  the  latter  groups  to  spend  more  time 
designing  and  mentally  simulating  procedures  away  from  the  coitputer.  Second, 
If  flowcharting  is  to  be  useful  as  a  design  aid,  considerably  more  time  and 
atiphasis  should  be  given  to  its  instruction  than  is  done  typically.  Poorly 
formulated  flowcharts  can  only  provide  weak  foundations  for  developing 
programs.    Third,  as  other  recent  studies  have  suggested,  males  and  females 
appear  to  have  much  the  same  potential  and  instructional  needs  for  learning 
programming.    Seemingly,  students'  increasing  exposure  to  computers  in  early 
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Reducing  the  Density  of  Text  Presentations 
Using  Alternative  Control  Strategies  and  Media 


A  critical  process  in  developing  lessons  for  computer-based  instruction  (CBI) 
IS  to  aetermine  the  manner  in  which  information  will  be  displayed  on  the  screen. 
Unfortunately^  in  many  cotmercial  CBI  products^  the  computer's  s^pecial  display 
capabilities  are  ignored^  much  as  if  the  monitor  screen  were  simply  an  electronic 
representation  of  a  print  page  (Burke,  1981;  Bork,  1987).    The  present  research 
addressed  this  issue  in  reference  to  the  specific  problem  of  displaying 
instructional  text.    The  underlying  assumption  was  that  reducing  the  density  of 
text  presentations  would  be  effective  for  improving  readability  and  learning 
under  CBI.    In  the  present  study,  a  "low  -density"  version  of  an  instructional 
unit  on  central  tendency  was  prepared  from  conventional,  "high-density"  text  by 
reducing  sentences  to  main  ideas  and  deleting  unnecessary  modifiers,  articles, 
and  phrases. 

A  third  experimental  condition  was  "learner-control"  in  which  individual 
students  were  allowed  to  choose  the  density  level  they  preferred  at  the  beginning 
of  each  of  five  lessons.    Clearly,  the  issue  of  learner-control  has  attracted 
considerable  interest  and  extensive  inquiry  among  CBI  researdiers.    Although  some 
studies  have  shown  positive  results  for  learner  control,  recent  findings  have 
more  often  been  negative  (Carrier,  Davidson,  &  Williams,  1985;  Tennyson,  1980). 
An  overall  interpretation  is  that  many  sudents,  especilly  low-achievers,  lack  the 
expertise  to  make  effective  decisions  regarding  the  quantity  and  type  of 
instructional  support  to  select.    On  the  other  hand,  learners  may  be  sufficiently 
perceptive  about  personal  interests  and  learning  styles  to  judge  what  mode  or 
form  of  presentation  best  accoitmodates  their  needs.    Given  this  rationale,  we 
examined  the  questions  of:    (a)  What  learner  characteristics  relate  to  the 
selection  of  high-  and  low-densiy  material?  and  (b)  How  does  learner-control 
overtext  density  influence  learning  and  motivation?   Other  features  of  the  design 
permitted  examination  of  an  extended  learner-control  strategy  that  allowed 
selection  of  presentaton  medium  (print  vs  CBI)  in  addition  to  density  level,  and 
of  aptitude-treatment  interaction  (ATI's)  effects  involving  reading  ability  and 
prior  achievement. 

Method 

Subjects  and  Design 

Subjeccs  were  221  preservice  teachers.    They  were  randomly  assigned  to  seven 
treatmpiit  groups  arranged  according  to  a  2  (presentation  mode:  CBI  or  print)  x 
3 (density  condition:  high,  low,  or  learner  control)  factorial  design  with  one 
oui-^ide  condition,  "full"  learner  control  (density  and  media  selection) . 

Preattitude  survey  and  pretest.    This  measure  consisted  of  a  brief 
questionnaire  to  aetermine  subjects'  attitudes  towards  the  stibject  to  be  taught 
and  CBI.    Ratings  were  recorded  on  a  five-point  Likert-type  scale,  with  "5" 
representing  the  most  positive  reaction.    For  full-LC  subjects,  an  additional 
item  indicated  that  during  the  instructional  phase  they  might  be  asked  to  study  a 
lesson  from  either  printed  materials  or  from  a  computer  lesson,  and  to  <*eck 
vrtiich  of  the  two  modes  they  would  prefer.    The  unit  pretest,  administered  to  all 
subjects,  consisted  of  10  items  on  the  material  covered  in  the  instructional  unit 
on  central  tendency. 
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r.^o??^^^!?:°^""y  S^^'^  subjects  were  adninistered  the  "comprehension  and 

rate   section  ot  Form  D  of  the  Nelson-Denny  Reading  Test  (Brown,  1976) . 
27r?S!^:°^       Insured  by  having  examinees  read  eight  paragraphs  and  answer 
™S  !;;f     °L''"*-1*''?~,?"  Reading  rate  was  measured  by  asking  then  to 

record  the  nunber  of  the  ln«  they  had  reached  following  the  initial  60  sec.  of 

Instructional  unit.    The  learning  material  was  an  introductory  unit  on 
central  tendency  prepared  by  Morrison,  Ross,  &  o'Dell  (1988).    The  content  was 
adapted  from  self-instructional  learning  modules  used  in  an  undergraduate 
SJfSJe'^.S''^'../''''  'research  purposes,  the  unit  was  organized  into  five 
sections  ("lessons")  covering  the  mean,  the  median,  the  mode,  uses  of  central 

"ir^Jf  distributions,  and  positions  of  central  tendency 

™^  in  different  distributions.    Brphasis  was  on  teaching  facts  and 
conceptual  information  that  students  would  need  to  recall  for  solving  and 
interpreting  problems.    A  conventional  (high-density)  print  version  of  the 

lo^*"^""        original  text  (Ross,  1982),  was  initially  prepared. 
Total  length  was  18  pages  and  2,123  words.    Within  each  lesson  the  basic 
instructional  orientation  involved  defining  the  main  concept  or  idea  and  then 

^ni"f2*  f«oi?"  "^^^  ^''^"^  numerical  exanples.    Following  Reder 

and  Anderson's  (1980;  1982)  procedure,  the  low-density  version  was  developed  by 

^^  '^'^^        shortening  the  material,  (h)  having  at 

l^ftJ^  judges  discuss  the  n.ies  and  rewrite  the  materials  accordingly,  Ind  (c) 
reviewing  the  material  and  n«.!.ing  changes  until  consensus  was  achieved  that  all 
criteria  were  satisfied,         rules  employed  were: 

1.    Reduce  sentences  ro  their  main  ideas. 

a.  ^ve  any  L-n-iecessary  modifiers,  articles,  or  phrases. 

b.  Split  conf,j.t.x  sentences  into  single  phi  • 


2. 
3. 


Use  outline  form  instead  of  paragraph  form  wnere  appropriate. 

Delete  sentences  that  surmarize  or  amp] ify  without  presenting 
new  information. 


4.    Present  information  in  "frames"  containing  limited  amounts  of 
new  information. 

r«.i;,!?L'^iS^-^!!!:;;^^".'*'^  cx>nPisted  of  1,139  words,  a  56%  savings 

3  ^  ^Si®"'^*^  version,  and  15  pages,  a  17%  savings.    CBI  versions 

^^«!!?.V-  low-density  lessons  were  prepared  directly  from  the  print 

materials.   Wbrd  counts  for  corresponding  low-  and  high-density  versions  were 
irl?^i''™'^°"  conputer  modes.    Due  to  the  much  smaller  display  area 

Of  the  computer  screen,  it  was  not  possible  (or  considered  desirable)  to 
duplicate  the  print  page  formats.    Corputer  frames  were  thus  designed 
i^r?S^"J-^'  "^"^  subjectively  decided  to  be  the  most  appropriate 

sSch  n  i2i?n^^?Ki^^?"^^:.         orientation  emphasized  organizational  devices 
voSL?  -if^  JS!;-^^**"^  ^^^^^  ^P*^'"        standard  uses  and  locations  of 
^^T^L  f  Pronpts.    Each  screen  provided  both  back-  and  forward-paging 

S  iS       IS®/"^   versions  of  the  low-  and  high-density  CBI  lessons  consisted 

alona  !??h  fJ" ^nf?^?^^"^^^'    ^'^""^  ^  ^"^  °^  the  high-density  frames 

axong  with  its  parallel  low-d«isity  version. 
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Insert  ..igure  1  about  here 


Attitude  survey,    a  e-item  printed  attitude  survey  was  administered  to  all 
subjects  at  the  coipletion  of  the  lesson.    Items  consisted  of  statements  about 
the  learning  experience  to  which  subjects  indicated  levels  of  agreement  or 
disagreement  on  a  5-point  Likert-type  scale  (e.g.,  1  =  "strongly  disagree,"  5  = 
"strongly  agree") . 

Achievement  posttest.    The  achievement  posttest  (print  format)  consisted  of 
three  sections  designed  to  assess  different  types  of  learning  outcomes.  The 
first  section  was  labeled  a  knowledge  subtest,  since  it  assessed  recognition  or 
recal'  of  information  exactly  as  it  appeared  in  the  text.    The  first  17  knowledge 
items  were  multiple-choice  questions,  each  consisting  of  a  statement  defining 
one,  all,  or  none  of  the  three  c-ntral  tendency  measures  (mean,  mode,  or  median). 
Eight  additional  questions  asked  fhe  student  to  determine  relative  placements  of 
the  mean  and  the  median  in  distributions  that  were  exact  replications  of  examples 
that  appeared  in  the  lesson.    On  four  of  those  items,  subjects  were  asked  to 
write  a  brief  rationale  for  their  answers. 

The  calculation  subtest  contained  five  problems  requiring  canputation  of 
different  central  tendency  measures  from  new  data  not  used  in  lesson  exanples. 
The  transfer  subtest  consisted  of  13  i^ems  that  involved  interpreting  how  central 
tendency  would  vary  with  changes  in  d.  tributians  or  individual  scores.    Items  of 
this  type  were  not  included  in  the  lesson,  nor  were  the  underlying  principles 
needed  to  answer  them  explicitly  stated. 

Scoring  rules  on  objective  items  and  calculation  problems  awarded  one  point 
for  a  correct  answer.    On  interpretative  items,  one  point  was  awardea  for  a 
correct  answer  and  an  additional  point  for  a  correct  explanation.    A  sutnnary  of 
subtest  anu  total  test  lengths,  maximum  points,  and  KR-20  internal  consistency 
reliabilities  is  as  follows:    knowledge  (25  items,  29  points,  r  =  .81); 
calculation  (5  items,  5  points,  r  «.68);  transfer  (13  items,  20  points,  r  =  .82): 
and  total  test  (43  items,  54  points,  z  =  .90).  ~ 

Delayed  posttest.    The  delayed  posttest  (  r  =.84)  consisted  of  13  items 
patterned  after  pretest  items.    Ten  of  the  iteiiis  tested  knowledge  defini  tions  and 
relative  positions  of  central  tendency  measures;  the  other  three  tested 
comput-ational  skills. 

Procedure 

The  preattitude  survey,  pretest,  and  reading  teat  were  artainist*ired  during  a 
regular  class  session.    During  the  learning  phase  of  the  study,  from  2-12 
subjects  representing  a  random  mixture  of  treatments  attended  an  individual 
session.    The  classroom  used  for  the  CBI  condition  contained  12  Apple  lie 
computers.    Following  introductory  instructions  and  a  revie»  of  prerequisite 
information,  the  learning  materials  were  distributed  according  to  treatm«it. 
Full-U:  subjects  received  their  preferred  presentation  mode,  CBI  or  print,  as 
selected  on  the  preattitude  survey. 

Instructions  for  all  treatments  indicated  that  (a)  five  lessons  would  be 
presented  on  central  tendency;  (b)  learning  was  to  be  self-paced;  (c)  turning 
back  to  reread  preceding  pages  (or  frames)  was  permitted  if  desired;  d)  it  was 
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permissible  to  ask  the  proctor  any  questions  about  the  task  procedure  v*iile 
learning;  and  e)  a  posttest  would  be  given  following  the  learning  task.  Subjects 
in  the  two  ix:  treatments  received  additional  instructions  indicating  that^ 
depending  on  how  much  explanation  they  desired^  they  could  choose  between  "long" 
and  "short"  presentations  on  each  unit.    Examples  of  matched  high-  and 
low^nsity  diq)lays  were  shown  to  help  them  make  a  selection  for  the  initial 
lesson.    In  the  CBI  condition^  subjects  pressed  a  key  to  indi^  te  their 
preferences;  in  the  print  condition  they  informed  the  proctor.    Density- level 
selection  was  repeated  at  the  beginning  of  each  of  the  remaining  four  lessons. 
After  subjects  completed  the  last  lesson^  their  finish  times  were  recorded  and 
the  attitude  survey  and  immediate  posttest  were  adninistered.  Approximately 
three  weeks  later,  thej  were  administered  the  delayed  pottest  at  the  beginning  of 
a  regular  class  meeting. 

Results 

Major  dependent  variables  consisted  of  four  achievement  measures  ^knowledge, 
calculation,  and  transfer  subtests;  delayed  posttest),  total  attitude  score,  and 
lesson  completion  time.    In  preliminary  analyses,  no  differences  were  found 
between  treatment  groups  in  pretest  performance,  pretask  attitudes.  Leading 
comprehension,  or  reading  rate. 

Learner  Control  Analyses 

Full-  vs.  partial-I£,    In  an  initial  set  of  analyses,  outcomes  in  the 
partial-u:  and  full-LC  treatments  were  conpared.    Inspection  of  LC  treatment 
means  showed  them  to  be  quite  similar  to  one  another  and  directionally  higher 
than  those  for  the  standard  high-  and  low-density  treatments.    A  2(LC-strategy)  x 
2  (presentation  medium)  MANOVA  on  achievement  confirmed  the  former  irpression  by 
failing  to  show  any  significant  effects  due  to  LC-strategies.    Nor  ware 
significant  LC-strategy  effects  obtained  in  a  univariate  ANOVA  on  attitude 
scores*    The  ANOVA  on  completion  time,  however,  yielded  a  significant  LC-strategy 
X  presentation  medium  interaction,  F  (1,69)  «  5.71,  £  <  .02,  and  LC-strategy  main 
effect,    F  (1,69)  «  7.73,  £  <  .01.  "Follow-ip  analyses  indicated  that  in  the 
print  cordition,  no  differences  occurred  between  learner  control  variations,  but 
under  CBI,  the  full-u:  group  (  M  »  18.9  min.)  took  significantly  less  time  than 
the  partial-u:  group  (  M  «  29.0"min.).    Thus,  those  who  selected  CBI  coctpleted 
the  lesson  more  quickly  than  those  vAio  were  prescribed  CBI  (partial-LC) ,  perhaps 
as  a  result  of  having  qreater  experience  and  confidence  in  using  that  mediun. 
Another  explanation,  supported  in  the  next  analysis,  is  that  faster  readers  were 
more  apt  to  select  CBI  than  print,  thus  giving  the  full-LC  group  a  built-in 
advantage  on  the  completion  rate  criterion. 

Media  preferences^    Media  selections  by  the  full-LC  group  were  almost  equally 
distributed  between  print  (  n  «  11)  and  CBI  (  n  «  13) .    For  exploratory  purposes 
a  discriminant  analysis  was  performed  using  the  subgroups  as  the  criterion  and 
the  following  as  predictors:    preattitudes,  pretest,  reading  comprehension,  and 
reading  rate.    Applying  step-wise  selection,  only  reading  rate  was  found  to  be  a 
significant  discriminator  (  p  <  .01) .    Subjec  s  who  selected  CBI  had  higher 
reading  rate  scores  (  M  «  271.8)  than  those  who  selected  print  (  M  =189.3) . 

Density  selections^    A  2(£X:-'Strategy)  x  2  (presentation  mode)  ANOVA  was 
performed  on  the  total  number  of  low-density  selections  (out  of  a  possible  5) 
made  by  ix:  subjects.    No  significant  effects  were  found.    Overall  means  were  3.5 
for  print  and  3.0  for  CBI.    Thus,  there  was  a  general  tendency  by  subjects  to 
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prefer  low-density  materials,  regardless  of  presentation  mode.    To  -xamine 
whether  certain  types  of  individuals  were  more  likely  than  others  to  select 
low-density  material,  the  number  of  low-density  selectins  was  regressed,  using  a 
r!S7!li^  procedure,  on  the  four  pretask  predic±or  variables.    Again,  only 

^  significant  predictor,  (  £  <  .01).    As  reading 
Skills  decreased  the  tendency  to  select  low-density  material  also  declined. 

Density  Condition  X  Presentation  Mode  Analyses 

For  analyses  of  achievement  and  attitudes,  data  from  the  full-  and  partial-LC 
treatments  were  pooled  within  presentation  modes.    Results  for  each  variable  are 
reported  below. 

Achievanent.    The  2  x  2  MANOVA  on  achievement  data  showed  both  main  effects 
to  be  significant  (  £  <  .05).    In  follow-up  univariate   asts,  the  density 
condition  effect  was  significant  on  all  dependent  measures  except  the  knowledge 

o  o^'    '^^^^  ~  ccniparisons  showed  that  on  the  calculation  subtest,  F  (2,215) 
=2.88,  £  <  .05,  the  EC  group  (  M  =  3.71)  was  directionally,  but  not 

^^^T^^o^  to  both  the  low-density  (  M  -  3.19)  and  high-density  (  M 
7  M     L^^/^K*.  °"  the  transfer  subtest,  F  (2,2I5T  »  5.53,  £  <  .01,  the  LC  groGp 

5  °  I  ^  significant  advantage  (  £  <  .01)  over  the  low-density  group 

(  M  =  9.58)  and  a  near-significant  advantage  (  £  <  .10)  over  the  high-density 
group  (  M  =  10.58).    Similarly,  on  the  delayed  posttest,  F  (2,186)  =  5.41,  p  < 
,Z'  ^^n^  ^^^^  (  M  =  8.30)  was  significantly  superior  to  the  low-density  group 
t  M  =  7.02),  and  directionally  superior  to  the  high-density  (  M  =  7.34)  group. 
None  of  the  comparisons  betwe«i  high-  and  low-density  means  was  significant.  The 
T-L^i^^^^f^"^  presentation  mode  effect  occurred  on  the  delayed  posttest  on 
which  CBI  subjects  (  m  =  7.95)  surpassed  print  subjects  (  M  =  7.00),  F  (1,186)  » 
8.61,  £  <  .01.  ~  — 

Attitudes  and  Completion  Time 

The  two-way  ANOVA  on  attitude  total  scores  failed  to  yield  any  significant 

r  M^f'c.^"?'!?^ ^?!?.^^'^^  "^^^  CBI  (  M  =  25.8  min.)  than  for  print 

(  M  =21.5),  F  (1,144)  =  4.45,  £  <  .05;  and  for  high-density  (  M  =  2G.5)  than  for 
low-density  text  (  M  =21.0),  F  (1,144)  =  8.60,  £  <  .01. 

Learning  from  High-Density  Microtext 

A  collateral  research  interest  was  the  relationship  between  student 
characteristics  and  learning  from  high-density  microtext.    Separate  stepwise 
multiple  regressions  were  performed  on  criteria  consisting  of  iirmediate  and 
delayed  posttest  scores,  attitude  total  score,  and  completion  time.  Predictor 
measures  consisted  of  the  pretest,  pretask  attitudes,  reading  scores,  and,  where 
apprc^riate,  other  "criterion"  variables. 

When  ininediate  posttest  scores  were  treated  as  the  criterion,  reading 
jxmpjehension  (simple  r  «  .51)  was  the  first  predictor  entered  in  the  equation 

-  '-J^^'  ^  ^  .001).    Pretest  score  (simple  r  »  .26; ,  which  had  been 
expected  to  be  the  strongest  predictor,  was  entered  on  the  second  step,  but  made 
a  relatively  weak  contribution  to  the  equation.    No  other  predictors  were 
entered.    Other  findings  v;ore:    (a)  no  predictor  variables  were  significant  in 
accounting  for  variance  in  completion  time,  (b)  pre-attitude  score  was  the  only 
significant  predictor  of  attitude  total  score,    (c)  and  pretest  score  was 
selected  on  the  first  step  and  reading  comprehension  on  the  second  step  with  the 
delayed  posttest  as  the  criterion. 
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Discussion 


1980^98T^S  f^^'  ^^"^^"^^  '"'^^  P""'^  ™terial  (Reder  &  Anderson, 

on  eCerf^hi^^e^^  SL^  ^«  effective  as  high-density  teit 

on  every  acnievement  measure.    Importantly,  low-density  narrative  offered  the 

S^'^^it'f^r"^  '^.'"^         ^  print'^conSJ^ion  a^  bjl8%  !n 

the  CBI  condition.    Results  were  supportive  of  learner-control  by  showina  it  to 

;    ^  learner-control  studies  are  sunmarized  by  some  global 

^apS^  s^SS;'%  ir'T  ^"^'^^l'-"  ineffectiveness  (or  effectiveness)  as  an 

interpretations  can  be  misleading  since  they  fail  to 
sS^T^.f^  "^"^  ^      learner-Sntrol  tha?can  be 

^S^f  f  ^^^"^'^  ^^ntrol  of  instructional 

?u  tendency  by  low-achievers  to  make  inappropriate  decisions 

(Ross  &  Rakow,  1982;  Seidel,  1975).  ^naFHtyp'-iate  aecisions 

P^J  i!^Lr?ti!^J  ?  '  -"'^  negatively  correlated  with  reading  ability. 

Se  i^t™??^^  natrative  support  whereas  gSd  readers 

timT  ye^  SliS^Slv         iSSf  low^nsity  lesson  which  could  reduce  reading 

°  support  comprehension.    These  appear  to  be 

pedagogically  sound  decisions  for  the  stdent  groups  concerned. 

pres^t^jiSJ  fif^  Clark    1985),  no  meaningful  differences  between 

S^rSS  ^Tf  ilJ:^     2"?^  outcomes.    From  a  practical  standpoint, 

comparing  media  seems  much  less  iiiportant  than  the  selective  and  systematic 

Te^^^St  th^  "^'r'  ^  ^^'''^  -^i-  th^t  n^S'^'Jfully 

fSr^  '^^^'f  traditional  text  narrative 

f^T  f  2  ^    ^  purposes  for  CBI.    The  availability  of  low-densitv  text 

tohlr'%"?t\'nt?rrS^«SbW  ^^^^  ^"  narratJJe°fe^S;;f"d:^Jv^"'' 

tutcner  attention  as  possibly  oeneficial  alternative. 
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"9"*^  ^-    Parallel  high  and  low  density  frames  from  the  instructional  unit. 

✓  ■  

The  median  corresponds  to  the  middle  frequency  score  in  a  ranl^ed  set  ^ 
of  data 

Half  the  scores  will  be  higher 
Half  will  be  lower 

X  f 

Hi  50% 
Median  

Lo  50% 

If  N»40  (40  scores),  median  «  20th  score 
If  N-17,  median  -  8.5  highest  score 

Median  corresponds  to  the  50th  percentile 

Higher  than  half  the  scores 
Lower  than  half 
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°*        tendency,  is  the  number  that 
^  12?"®  fr«<»"8"cy  (that  is.  the  middle  score)  in  a 
iSi?  ?       ^         ^     value  that  divides  your 

K*^'     0*  the  scores  will  be  higher  than  the  median, 
and  half  will  be  lower  than  the  median. 
X  f 

HI  50% 
Median   

Lo  50% 
JLSi"??**?*  ^  remember  that  the  median  is  the  halfway  point  in  the 

Po'O'^niple.  if  N-40  (meaning 

2^LJS  5T!M?  S*'®?:.*^  ^"  ^  20th  score  (in  terms 
of  rank);  if  N.17,  the  median  will  be  your  8.5  highest  score,  etc. 

Another  way  of  defining  the  nrtedian  is  to  say  that  It  corresponds 
to  the  50lh  percentile.  ^ 

In  any  distribution,  the  median  will  always  be  the  score  that 

*°  I  Porcentile  rank  of  50;  it  is  higher  than  half  the  scores, 
and  tower  th&n  half  the  scores. 
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The  Apple  Classroom  of  Tomorrow  Program 
with  At-Risk  Students 


A  growing  number  of  our  nation's  students  are  considered  academically  at 
risk.    The  precipitating  circumstances  vary  from  individual  to  individual ^  but  in 
a  multitude  of  cases  it  is  a  combination  of  disadvantaged  backgrounds  and  limited 
resources  at  home  and  often  at  school.    Encouragingly ^  through  the  design  and 
application  of  specialized  programs  such  as  continuous  progress  learning^ 
individualized  instruction^  and  cooperative  learning,  considerable  progress  is 
being  made  in  improving  the  academic  performance  of  these  children  (Slavin  1988) • 
Offering  further  hc^  is  the  still  untapped  potential  of  instructional  technology 
to  make  powerful  educational  interventions  available  to  supplement  conventional 
instruction.    Such  a  program,  called  the  Apple  Classroon  of  Tomorrow  (AOOT) ,  is 
the  focus  of  the  present  study. 

The  research  context  is  an  inner-city  elementary  school  with  an  enrollment 
of  900  students,  nearly  all  of  whom  are  black.    For  these  at-risk  students, 
failure  and  drop-out  rates  far  exceed  state  and  national  nouns.    The  purpose  of 
ACOT  is  to  establish  a  saturated  computer  environment  both  to  supplement 
conventional  instruction  with  CBI  and  to  teadi  applications  skills  (such  as 
word-processing)  to  facilitate  performance  of  school  tasks.    The  rationale  is 
that,  through  successful  participation,  students  will  acquire  increased 
motivation,  self-confidence,  and  competence  in  basic  skills  and  ind^ndent 
learning.    Although  the  program  has  many  different  components  (CBI,  Logo 
training,  software  applications) ,  of  particular  interest  to  the  present  research 
was  the  use  of  telecomnnunications  to  make  one-to-one  tutoring  of  the  children  by 
college  students  both  cost-effective  and  practical. 

The  AOOT  program  was  initiated  in  the  fall  of  the  1986-87  school  year 
through  a  grant  from  Apple  Computer  to  equip  classrooms  with  microcomputers  at 
the  fifth-  and  sixth-grade  levels.    Importantly,  uses  of  these  computer  resources 
were  designed  to  support  specific  instructional  strategies  identified  as  having 
high  potential  to  benefit  the  student  pqpulation  concerned.    Specific  components 
are: 

(1)  Each  student  and  teacher  receives  a  computer  to  ur^  i*:  school  and  another  to 
use  at  home,  thus  allowing  for  virtually  unlimited  :o<nputer  access  for 
working  with  CBI  programs  and  practicing  applications  skills. 

(2)  Training  in  basic  skills  and  in  using  tool  softwar    - s  amphasized. 

(3)  Parents  are  integrally  involved  by  being  required  to  attend  training 
sessions  and  set  up  the  home  computer  systems.    They  are  also  encouraged  to 
work  with  their  children  in  completing  ACOT  homework  assignments. 

(4)  Seemingly  the  most  powerful  intervention  is  the  assignment,  to  each  student, 
of  a  personal  tutor  who  is  an  education  major  at  a  local  university.  The 
tutor  leaves  assignments  and  writes  messages  and  feedback  over  an  electronic 
Bulletin  Board  System  (BBS)  accessed  by  modem.  This  type  of  application 
extends  existing  tel^hone  tutoring  sLrategies,  "homework  hotlines,"  and 
distance  learning  programs  (Butler  &  Jobe,  1987;  Davis  1987;  Pedley,  1987; 
Wood,  1986;  Zeller,  1987)  by  (a)  fostering  close  and  long-term  relationships 
between  tutors  and  tutees,  (b)  maintaining  messages  and  feedback  for 
long-term  review,  and  (c)  embedding  instructional  communications  within  an 
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integrated  academic  program  created  and  delivered  through  a  partnership 
Between  teadiers,  tutors,  parents,  and  university  faculty. 

JJfS2??l;<^f  ccxrputer-saturated  program  has  considerable  face  appeal,  its 

S^aeS^tHSlJL?^  assumed  on  that  basis  alone.    Any  inr«diate  benefits  may 
nL^f ^  ^'^^  ^^^^^^  °^  individualizec^  attention  provided 
?l,^rr^  ?  ^J^^  f"^        ^  resources.   Accordingly,  extensile  and 

evaluations  have  been  planned  to  determine  participants'  activities  and 
tl]^'  ^  P'^ogratn's  methodological  strengths  and  limitations,  and  the 

instructional  strategies.    Studies  conpleted  this  past 
J?tii?pre2S^p^J.  tutoring  component.    This  research  will  be  thTfocus 

Program  Methodology 


Recruitment 


n«io«  wS?^  2  ?  ?  ^^^^  that  college  education 

SSifnT^  r,  ^  i'^^  candidates  given  their  interest  and  experiences  in 
l^^J?',^l^  '^  ^!!L'f^^  solicited  from  the  Master's  of  Arts  in  Teaching 
Progr«,  (MAT)  at  Memphis  State  University.    This  particular  group  had  several 

i^JfS^^^JL^^""'^"'^*  ^°  1^-^"  f^^"*  fi"t»^^"d  experiences 

?r!?iiS^  ^t""  1?^^      schools.    Another  was  to  broaden  their  teacher 

SSS^^n'^Ji"^  ^t^"t«       the  ACCXr  classro^.  A 

Si  iSSi^     ;  J  ^  "^J^"  P«"°n^l  work  during 

«Hvi?2^i  XS""**     ^^"""^  opportunity  to  conduct  their  Master's  thesis 

?J^f      ^  °f  ACOT-related  topics,   with  these  built-in  incentives, 

iJe^inT?  orS'i?'??         ^  ^  ""f!  volunteers  than  space  could  acconncdate. 
^-Lfi^^  •  ^°  consisted  of  four  males  (one  minority)  and  six 

fS^'  SS'JS      ^-  2^  ^°  teaching  concentrations  included 

science,  English,  foreign  language,  social  studies,  and  music. 

The  BBS  System 

irJf!         system  was  a  512  Macintosh  with  a  20  megabyte  hard  disk  drive  and 
^anf  tS'S^I??"^*    °^„S<3i°-ted  phone  line  S  Sed  for  all  incoming 
usli^\n^?f  Tin  SSl'^"^^  S"^^"ts  and  tutors  accessed  the  BBS 

aoS;,r2   ^      cotpiter,  an  Apple  Personal  Modem,  and  Apple  Access  II 

they  entered  their  -pecial  code  name  and  were  then 
tSeJTlSloSc?^  ^^^^^iJl^""'  ^"^  "^^^5^^  *-'^t  had  been  sent  to  them  since 
^h!^  S,  ^^^^^  ^  sender's  name  and  message  number.    They  could 

Srs?2«  o^r^  S?^?^''T  '°  '^"^^^  °^  delete^mSsages. 

St^S2^n?tn^«^f  preset  a  clearance  time  limit  for  each  group  of  users, 
f^^^^  S  ^"tors  primarily  ccnmunicated  over  a  "public"  bulletin  board  that 

n^iS2fp'^ii^^'  ^^^^^  ^"  electronic  mail  secUion  to  Lnd 

private  messages.    In  posting  a  message,  the  user  entered  the  recipient's  name 

i?a^  S'^L^rS^^J'J^^:   ^^ter  typing  the  message,  he/she  could  choose  to  send 
ion^ihS^  !f  lu^'^  *^®^^te  It.    File  transfer  was  not  easily 

accomplished  and  therefore  was  not  used. 

The  Tutoring  Model 

i.,-«inTIl^  tutoring  project  was  initiated  by  conducting  several  orientation  and 
Siv  SnSnS  students,  their  parents,  and  tutors,    the  sessions  gaJe 

basic  demonstrations  of  how  to  connect  and  operate  the  computer  equipment. 
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Although  participants  typically  had  little  or  no  cotputer  experience,  they 
appeared  to  encounter  little  difficulty  in  learning  these  skais.    A  second  part 
of  th^?  l-.aining  dealt  with  the  procedures  for  using  the  BBS. 

Tutoring  assignments  during  the  year  were  primarily  activities  ^esigned  to 
develop  writing  skills.    One  assignment  was  for  the  student  to  write  a  friendly 
letter  using  a  format  taught  in  class.    The  tutor  read  the  letter  on  the  BBS  and 
responded  with  suggestions  about  improvements,  which  the  tutor  attempted  to 
incorporate  in  the  next  draft.    This  type  of  interaction  was  repeated  until  the 
tutor  was  satisfied  that  the  letter  met  the  teacher's  criteria.    The  tutees  were 
graded  by  the  teadier  based  on  the  quality  of  the  work  and  degree  of  BBS  use. 
Next,  the  tutors  wrote  a  letter  convqring  purposeful  mistakes  to  the  student. 
The  student's  task  was  to  read  the  letter  and  identify  the  mistakes. 

A  second  kind        '^signment  was  used  to  help  students  expand  their  reading 
and  writing  vocabulctjuy.    Each  student  constructed  an  Appl^orks  data  base 
containing  four  categories  of  information:    new  words,  context  sentence, 
definition,  and  original  sentence.    Tutors  used  the  data  base  to  develcp  learning 
exercises  incorporating  those  words.    In  addition  to  these  and  other  formal 
assignments,  tutors  and  students  were  encouraged  to  use  the  BBS  to  share  evarydav 
experiences  and  keep  in  regular  contact  with  one  another. 


Research  Methods  and  Findings 

Participant  groups  in  che  research  consisted  of  120  fifth-  and  sixth-grade 
AOOT  students  and  their  parents,  teadiers,  and  tutors.    Control  groi^  were 
conprised  of  approximately  equal  numbers  of  children  attending  matched 
conventional  classes  at  the  same  school.    The  research  orientation  included 
formative  evc^luation  of  instructional  materials  and  nethods  to  determine  how  they 
were  working  and  to  identify  any  needed  refinements;  and  sumnative  evaluation  to 
examine  end-of-year  outcomes  on  a  variety  of  performance  and  affective  variables. 
Some  of  the  studies  were  time-series  designs  involving  the  AOOT  group  only, 
whereas  others  wt^re  quasi -experimental  ccxtparisons  bet'  ^en  AOXT  and  control 
classes. 


The  focus  of  conpleted  research  studies  include  the  following:    (I)  ACOT 
pre-post  gains  and  outcomes  on  si indardrzed  achievement  (CAT)  tests,  school 
attendance,  and  motivation/self-conoep     aasures;  (II)  the  thematic 
classification  of  student/tutor  messa^^  >  on  the  BBS;  (III)  the  influences  of  BBS 
activity  on  keyboarding  skills;  (IV)  modem  tutor  roles  and  attitudes;    and  (V) 
ACOT  activities  and  the  developtnent  of  writing  skills. 

A  sumnnary  of  the  major  findings  by  study  is  as  follows: 

Study   I:    AOOT  students  were  superior  to  cont:ols  in  CAT  reading  and  math 
performance  (Kitabchi,  1987;  198P) . 


II:    (A)  Girls  used  the  BBS  more  than  boys,  especially  for  communicating 
with  friends.    (B)  The  BBS  was  extensively  used  during  the  year  for 
exdianging  social  and  academic  messages.    (C)  The  quantity  and  length 
of  messages  were  not  related  to  students'  ^academic  achiev€m=»nt 
(Ulrich,  1988). 

Ill:    (A)    Most  students  developed  considerable  proficiency  at  keyboarding 
over  the  school  year.    (B)  Keyboarding  skill  was  not  related  to  amount 
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IV: 


of  BBS  use  or  to  academic  achievanent.    (C)  Teachers  reacted 
positively  to  students'  keyboarding  accompli slments,  but  were 
frustrated  by  the  lack  of  a  systematic  model  for  teaching  those  skills 
(Hester,. 1988) . 

(A)  Tutors  generally  regardisd  their  activities  as  beneficial  to  them 
personally  and  to  the  tutees.  (B)  They  felt  that  a  mentoring 
'^Sf!:?"^*''?      "^^^  ^  tutored  and  encouraged  students  was  more 
effective  than  one  in  which  they  evaluated  students  by  grading  their 
work.    (C)  They  were  frequently  frustrated  by  the  difficulty  of 
accessing  the  BBS  due  to  its  single-line  connect  capability,  and  by 
(Parry   1988°^  clearly  specificed  tutoring  guidelines  or  assignments 

V:    (A)  Writing  skills,  evaluated  through  a  systematic  analysis  scheme, 
were  higher  on  several  dimensions  (clarity,  organization,  graninar)  for 
flow  students  than  for  the  control  group.    (B)  AOOT  students  generally 
concise  and  better  organized  essays  than  the  controls.  (C) 
Most  AOOT  students  preferred  to  write  using  a  coiputer  rather  than 
paper  and  pencil  (Woodson,  1988). 

Discussion 

Although  the  higher  standardized  test  performances  of  the  ACOT  group 
^SStrri^^  suggestive  of  positive  program  effects,  these 

results  need  to  be  viewed  cautiously.    Because  AOOT  provided  numerous  and  axrolex 
''lif''^  ^^^^^  attention  from  the  Lhool  sys^  T^  ^i^T 
J^nS^S!lI^'"^ff "-^"^^^^       effective  attributes  or  distinguish  them 

effects.    However,  given  this  promising  preliminary  evidence, 
f         J^^-^-  Pe'^S"!^"^'  will  be  closely  monitored  in  future  studies.  Also 

"ill  follow-up  AOOT  grauates  as  they 
attend  conventional  seventh-grade  classes  at  other  schools. 

«ro«r2T!?J^y:  '^'^^-^^I?i"^^"l  evaluation  outcomes  relate  to  participants' 
o5S«n  activities  and  the  competencies  and  attitudes  acquired  in  the  process. 
S^rnin^iT^       ""^^^'^^  supported  the  viability  of  the  program  rationale, 
particularly  the  components  of  intensive  computer  training  and  one-to-one 
using  telecommunications.    Iitportantly,  the  children  made 
SSJfiT  wni2  ^  conputer-based  instruction  for  learning,  while 

becoming  skilled  users  of  many  tool  applications.    An  especially  important 
Sr?n^l^  2^  ^  component  was  the  req-nrement  for  comSuanicating 

exclusively  through  reading  and  writing.    Thus,  a  student  population 
overr^resented  by  poor  and  reluctant  readers  and  writers  were  directly 
H^^Si""^^^  Si"^  conversing  on  a  regular  basis  with  friends  and 

io^S    in^fSf^  iTtu^t^^"^  ^^^^  °^  ^^^"1  "«3or  limitations  were 

?M  «  i  •  absence  of  a  clef.r  tutoring  curriculum  or  nethodology, 

coin^fi;   f  ?  ^^.^        ^°        availability  of  cnly  a  single-li^e 

S??^  J  %  ^^'l^^"^  °f  participaton  by  seme  children  in  the  AOOT  class,  (d)  the 
parents  on  a  continuous  or  systematic  basis  during  the  school 
year,  and  (e)  absence  of  a  program-oriented  instructional  nodel  for  teachers. 

r^r^J^  Apple-Link  Personal  Edition  is  being  used  in  the  1988-1989  program 
iL^S  flexible  BBS.    A  major  advantage  is  multiple  user 

^^i^^J^^^^  °'  *^i^l-^  networks.    Others  are  capabilities  for 

real-time  interactive  responding,  uploading  and  downloading  of  assignments  and 
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feedback,  and  privaqr  in  tutor-student  comnunications.    BBS  "chat  rooms,"  which 
allow  up  to  23  people  to  converse  in  real  time,  will  be  regularly  used  to  hold 
group  tutoring  sessions.    Also,  while  on-line,  students  will  be  able  to  "meetJi 
other  Apple-Link  usgrs  from  all  over  the  country,  "attend"  forums  on  computer" 
topics,  and  access  numerous  information  sources. (encyclopedia,  weather,  news, 
etc.).    Tutoring  assignments  are  also  being  more  carefully  planned  to  achieve  a 
better  fit  with  the  curriculum  and  the  distance  learning  envirorment.  Increased 
efforts  to  involve  parents  and  arrange  more  face-to-face  contacts  between  tutors 
and  students  during  the  school  year  should  build  a  greater  sense  of  comiunity  and 
stronger  relationships  among  participants. 
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TEACHING  SCIENCE  USING  INTERACTIVE  VIDEODISC: 
RESULTS  OF  THE  PILOT  YEAR  EVALUATION  OF 
THE  TEXAS  LEARNING  TECHNOLOGY  GROUP  PROJECT 


Introduction 

The  new  computer-based  technologies  for 
delivering  instruction  are  bringing  dramatic  changes 
to  the  classroom,    one  such  technology,  interactive 
videodisc,  is  being  used  in  the  first  project  of  its 
kind  in  the  nation  to  deliver  an  entire  full-year 
physical  science  curriculum  for  high  school  students. 
The  teacher's  role  in  teaching  this  curriculum,  rather 
than  being  limited  by  the  technology,  has  been 
expanded.    Teachers  who  teach  using  an  interactive 
technology  find  themselves  managing  groups  for 
cooperative  learning,  for  example,  in  new  ways.  They 
be -ome  directors  of  student  learning,  as  well  as 
mentors  and  guides.    They  serve  as  model  technology 
users  to  their  students.    They  must  integrate 
computer-based  lessons  into  their  normal  classroom 
planning.    They  need  not  only  be  familiar  with 
traditional  content  and  methods  in  their  subject  area, 
but  must  also  be  adept  at  orchestrating  lessons 
containing  more  varied  activities  which  use  technology 
in  ways  few  teachers  feel  prepared  to  handle  (Savenye 
&  Hudspeth,  1936) . 

This  paper  describes  the  background,  methodology 
and  results  of  an  evaluation  study  conducted  during 
the  pilot  test  of  a  semester-long  high  school 
chemistry  curriculum  delivered  via  computer-based 
interactive  video,  the  Texas  Learning  Technology  Group 
(TLTG)  project.    While  findings  with  regard  to  student 
achievement  and  student  attitude  will  be  summarized, 
the  primary  focus  of  this  paper  is  on  the  findings  of 
the  qualitative  research  study  conducted  to 
investigate  teacher  attitudes  and  teacher 
implementation  behavior. 

Overview  of  the  Texas  Learning  Technology  Group  Project 

Formation 

In  1985,  the  Texas  Association  of  School  Boards' 
Board  of  Trustees  responded  to  the  national  and  state 
crisis  in  science,  math  and  technology  education  by 
forming  a  partnership  to  produce  technology-based 
solutions  to  school  problems.    The  Texas  Learning 
Technology  Group  (TLTG)  Project  is  a  partnership  among 
the  Texas  Association  of  School  Boards,  the  National 
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Science  Center  Foundation,  Inc.   (NSCF)  and  twelve 
Texas  school  districts.     It  is  a  non-profit 
organization,  which  has  several  sources  of  funding, 
including  NSCF,  the  districts,  and  the  National 
Science  Foundation. 

The  goals  of  TLTG,  as  described  in  a  recent 
evaluation  report  (TLTG,  1989)  were  to: 

-  develop  high-quality,  low-cost  curriculum 
projects  that  integrate  new  technologies  into 
curriculum  delivery  systems, 

-  evaluate  the  "Effectiveness  of  a  technology- 
based  curriculum,  and 

-  train  teachers  in  the  use  of  new  technologies 
and  provide  support  to  schools  implementing 
these  new,  technologically  advanced  curricula 
(in  press) . 

After  consultation  with  a  curriculum  committee 
consisting  of  educators  from  local  districts,  state 
educational  agencies  and  universities,  TLTG  determined 
that  its  first  course  would  be  a  complete  physical 
science  curriculum,  due  to  the  shortage  of  science 
teachers  and  lack  of  student  motivation  in  physical 
science.    Other  committees  were  formed  to  develop 
CO.. cent  outlines  and  determine  objectives,  to  provide 
technical  assistance,  and  to  outline  teacher  training 
needs .  ^ 


Development  of  the  Curriculum 

Although  at  first  an  outside  company  was 
contracted  to  produce  the  curriculum,  TLTG  soon 
determined  that  quality  and  cost-effectiveness  would 
best  be  served  by  hiring  its  own  development  staff  to 
produce  the  courseware.    The  staff  included  managers, 
instructional  designers,  computer  programmers  and 
graphics  specialists,  a  video  and  marketing 
specialist,  subject  matter  experts  and,  physical 
science  teachers.     In  addition,  design  documents, 
including  instructional  flowcharts,  scripts  and 
storyboards,  were  reviewed  by  pilot  teachers  and 
national  award-winning  science  teachers,  physicists 
and  chemists,  and  university  spe    -^lists  in 
educational  technology,  science       cation,  chemistry 
and  physics. 
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Teacher  Training 


In  accordance  with  the  goals  of  TLTG,  teacher 
•^raining  was  planned  from  the  project's  inception. 
Pilot  teachers  participated  in  training  sessions  from 
one  year  before  the  time  the  courseware  was  to  enter 
their  classrooms  in  order  to  prepare  them  for  the  many 
changes  a  technology-based  curriculum  would  bring  to 
their  teaching.    On-going  training  sessions,  for  which 
the  teachers  may  receive  college  or  career- ladder 
credit,  are  schpduled  for  one  week  in  the  summer  prior 
to  teaching,  as  well  as  one  day  during  the  fall  and 
the  spring  semesters. 

The  training  sessions,  taught  by  TLTG  staff, 
experienced  pilot  teachers  and  university  professors 
and  other  specialists,  are  "intended  to  make  teachers 
more  comfortable  with  JVD  technology  and  enhance  their 
abilities  to  incorporate  a  technology-based  curriculum 
into  the  classroom"  (TLTG,  1989,  in  press;.  In 
addition  to  learning  how  to  operate  and  troubl,esnoot 
the  hardware  and  courseware,  teachers  learn  how  to 
manage  their  classrooms  using  the  technology, 
especially  how  to  design  lesson  plans,  and  encourage 
student  interaction  with  the  science  materials. 
During  the  training  sessions,  TLTG  also  solicited 
teachers'  feedback  regarding  their  opinions  of  the 
courseware  and  changes  \:hey  would  like  to  see  made  in 
subsequent  versions. 

Description  of  the  TLTG  Physical  Science  Curriculum 

The  TLTG  Physical  Science  curriculum  r  .isists  of 
6ne  semester  each  of  chemistry  and  physics,  making  up 
the  complete  state  requirement  of  160  hours  of 
joursework.     It  consists  of  fifteen  instructional 
units,  including  an  introduction  to  physical  science, 
seven  chemistry  units,  six  physics  units  and  one  unit 
on  energy  resources.    The  curriculum  integrates 
computer  and  videodisc-delivered  presentations  of 
information,  teacher-delivered  demonstrations, 
simulated  labs,  computer-based  practice  exercises, 
coatent-based  computer  games ^  wet  labs,  and  paper- 
based  practice  sets.     Included  with  the  videodiscs  and 
computer  software  is  a  teacher's  guide,  which  contains 
objectives,  pacing  chart,  script,  summary  notes, 
practice  sets,  wet  labs,  suggested  demonstrations,  and 
a  glossary;  a  student  guide,  and  unit  tests. 

The  TLTG  program  is  designed  to: 

o  Increase  students  '  in-depth  understanding  and 
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a"d%LMjr"'"^  °'  ^^'^"^^ 
o  Increase  the  students'  interest  in  science 
o  Show^the  relevance  of  physical  science  ?o  daily 

o  Prepare  students  for  an  increasinaly 

technological  world,  and, 
c  Prepare  students  for  academic  and  professional 
advancement  in  the  sciences  (TLTG,  l?89rin 


based^?essons°?n  ^^'^  ""^"^  computer- 

s?u1n"?s:"  ^lj^:J't^r^^l^'^l, 

r-sJl^d'f/""^^""'  '^^^^^  facx?itStor  '^ris'not 
a    stand-alone"  computer-based  curriculum.  " 

DOS  compatible  or  PS  2  computer)  ^Jweodrsc  ptaver" 

t*»<n-»S"Ji"^  ^''^  1987-1988  school  year  TLTG  pilot 
schoo?  llltril'tr^T"'  chemistry^ourse  In^JieWe 

TLirL'cS  ng  a"fi^?.s'Sa^e^^';}d'^^s^^'°°^  ^^^^ 

twenty  Texas  school  disiri'^'a^'i:  ?  ar^hr^e^""' 
S?aie"    Tht^^''  Louisiana  and  Washington 

of"h;  cL'iL?ry^%^  JL^ra^we^??  a^'^?Je-T^-^^^^r^°" 
field-test  year  evaluation?  ^  °^  ^'^^ 

Purpose  of  Formative  Evaluation 

■'^^'^^  curriculum  has  been  developed  using  a 

erder"^o?ma°t^!e:  t^^^r^^^^^^^^^ 

stages  of  the  systematic  process  for  devTlLinl'"^''^ 
jnstructxonal  materials  a^d  programs  illtlTclrey, 

b^se  decJsiin/S    "''^^fK^°  ^^^^  "P°n  which  to 

inl?ructioi      Pol^.^^?^  ""^^  revision  and  improvement  of 
tvDicalli  n;**^  evaluation  data  is  also 

typically  used  in  designing  subsequent  programs. 

inajor'"aJSai^''%!''^i"f       addresses  questions  in  three 
teacher  f?tii-nHi       "^^^^  achievement,  2)  student  and 
and  5!  use  if  2^  .^'''^'         curriculum  .nd  content, 
settinos      aI  1^1  P^°'3ram  in  actual  instructional 
settings.    As  the  major  stage  in  its  formative 
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Pilot  Year  (1987-88)  Evaluation 

her  chemistry  cfasses  usiJa"??p         °"  T"'  °' 
districts    stuSinf  f^h"    ^         curriculum,     m  most 

using  the  tradi^ir^n=,^  -Zk     •  ^  '^"^  which  were 

ng  tne  traditional  chemistry  curriculum. 

lur^rj^J^^."^""^""  exhibited  whil^  in,ple„,e„?J„,"t\e 
Pilot  Test  Evaluation  Goals 

xaoa  uu  waccn;  nine  classrooms  had  tParh#ar«rt*.^.,rx 

alaufo""o°the  t"\""^  '""P  w«ics?:tl»s'r°"' 

aaaition  to  the  teacher  workstation. 
Research  Questions 

The  following  research  questions  were  investigated: 
1.  DO  students  learn  more  physical  science  concept^. 
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using  the  IVD  courseware  than  they  do  from  the 
classroom  instruction  it  rep  ^  es? 


2.  Do  students  using  the  IVD  courseware  exhibit  more 
positive  attitudes  toward  science  and  the  study  of 
science  than  non-IVD  students? 

3.  Dees  the  amount  of  learning  difler  for  students 
with  different  levels  of  verbal  and  quantitative 
aptitude? 

4.  Does  the  amount  of  learning  differ  between  each  of 
the  two  system  configurations  (teacher-only  or 
teacher-group  configuration)  and  the  non-IVD  students 
when  students    aptitude  levels  are  taken  into  account? 

5.  What  are  the  teachers'  perceptions  of  the  TLTG  "electronic 
curriculum"  (TLTG,  1989,  in    press).  electronic 

Methodology 

Data  Sources 

Twenty-six  <-eacbers  and  2,560  students  in  12 
school  districts  pa.     -^ipated  in  the  IVD  pilot  study. 
Due  to  missing  student  information  in  some  of  the 
student  records,  2,297  student  records  were  used  in 
the  analysis.    Achievement  data  were  also  collected  on 
a  sample  of  the  students  (N  =  338)  who  took  physical 
science  from  some  of  the  pilot  teachers  the  year  prior 

o?  i^n^.r?^""^"^^!'^^"  °^         Pil°t  program.    A  sample 
of  control  group  (non-IVD)  students  about  equal  to  the 

instrLents'^^  ^^""^^  completed  the  study 

Teachers  administered  the  achievement  and 
^Pjj^^-^^^jjstruments  to  the  pilot  groups  during  i-he 

Instruments  and  Data  Analysis 

Student  aptitude  was  measured  using  the 
Developing  Cognitive  Abilities  Tsst  (DCAT) 
constructed  by  Donald  L.  Beggs  and  John  T.  Mouw  of 
Southern  Illinois  University,  administered  in 
September.    Quantitative  and  verbal  scores  of  students 
were  used  in  the  data  analysis. 

Student  achievement  was  measured  by  the  High- 
School  Subject  Tests,  Physical  Science  Test,  developed 
t>y  Scott,  Foresman  and  Company,  1980. 
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students '  attitudes  regarding  their  intention  to 
enroll  m  elective  science  classes,  were  measured  by 
the  Hxgh  School  Science  Courses  Questionnaire,  based 
on  ADzen  s  and  Fishbein's  Theory  of  Reasoned  Action. 
This  questionnaire  was  administered  in  May  of  1988  to 
a  subset  of  students  from  the  pilot  and  control 
classes  in  five  districts. 

Teacher  perceptions  toward  the  curriculum  were 
measured  using  an  attitude  questionnaire  developed,  fo] 
the  study  and  administered  during  the  April,  1988, 
teacher  training  session. 

Videotaped  classroom  observations.     Several  of  the 
pilot  teachers  were  videotaped  using  the  curriculum 
with  their  classes,  and  these  videotapes  were 
subjected  to  microanalysis  of  the  teacher  behaviors 
observed  during  use. 

Results  of  the  Pilot  Evaluation 

Findings  in  the  areas  of  student  achievement, 
student  attitude  toward  science  and  teacher 
perceptions  of  the  curriculum  were  reported  in  detail 
by  TLTG  (1989)  in  its  evaluation  report  and  in  a 
report  prepared  for  TLTG  by  the  Educational 
Productivity  Council  and  will  be  briefly  summarized 
here. 


Findings  in  the  areas  of  teacher  attitudes  toward 
use  of  the  curriculum  and  preliminary  results  of  the 
analysis  of  videotaped  classroom  observations  will  be 
presented  in  detail  in  this  paper. 

Student  Achievement 

Student  achievement  data  were  analyzed  by  IVD 
group  versus  control"  group,  IVD  students  by 
quantitative  and  verbal  aptitude,  as  well  as  IVD 
teacher-only  configuration  with  control ,  and  IVD 
teacher-group  configuration  with  control.  These  data 
indicated  that,  in  general,  the  effects  of  using  the 
IVD  curriculum  were  positive,  however  the  results  were 
complicated,  and  varied  considerably  by  teacher  and 
other  factors. 

In  general,  IVD  students  achieved  higher  scores 
than  non-IVD  students.     In  fact,  the  average  IVD 
student  performed  better  than  63%  of  the  control 
students.    These  differences  were  not  uniform,  but 
were  greater  for  low-ability  students,  especially  low 
verbal  ability,  with  these  students  outperforming  68 
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Jlas'sr^lis!"  °'         1— «^ili'y  students  in  non-IVD 


(....^^ilJ"^*"^^^  differences  in  achievement  were 
found  between  low-ability  students  in  the  teacher- 

L"-?v"SfaL"o»?"    ^"^  '--^"i^V  students  in  the 

Student  Attitudes 

IVD  students  indicated  a  greater  degree  of 
intention  to  enroll  in  and  elective  science  course 
than  control  students,    of  particular  interest  is  the 
finding  .-.hat  of  students  who  had  previously  failed  a 

TreTtll  inten^  ^f^'^'^  indicated  a 

greater  intention  to  enroll  in  science  than  their 

J°^S^^^P^^t^        ""^^  5^°"P  <EPC,  1988;  T^Jg, 

Teacher  Attitudes 

Teagjjer  perceptions  of  curriculum.     Nineteen  of 
and  T.T^'^'-r  ^^^'^hers  completed  an  "implementation 
and  use"  questionnaire  during  the  spring  teacher 
training  session  in  April,  1988.    All  of  the  teachers 
indicated  that  they  liked  using  the  curriculum?  SiS 
agreeing'"^  strongly  with  the  statement,  and  five 

easier°trn"        ^-^  teachers  indicated  that  it  was 
easier  to  teach  using  the  IVD  curriculum  than  it  was 
to  use  their  traditional  curricula. 

All  of  the  teachers  indicated  that  they  used 

anTi^rksJai.r'"""'''  ^"^''^  a^t'uies 

tit  o?         f     'k^"  conjunction  with  the  curriculum. 
fj\hf  J-     ^^f":^^^^  said  they  used  other  materials  10% 

50rAf  °^  1^1  of  the  time,  2 

^2*  h  ^"^  ^         °f  the  time.     Some  of  the 

Sev         curriculum.    For  example,  six  teachers  said 
they  did  not  use  some  of  the  wet  labs,  while  four 
teachers  said  they  did  not  use  some  practice  fets. 

l^;,rnoi^         teachers  felt  that  their  students  had 
lellnJ  ?n"  "^'"^  ""^^  ''^''^  curriculum  than  they  had 
th?f  ?n        P"^^0"s  years.     The  reasons  they  gave  for 
l^tLl  ^'^t'^^^''  TLTG  curriculum  provided  more 

oprortunities  for  participation  and  interaction,  the 
TtnZnt  stimulating  and  interesting  ?o 

students,  teachers  saw  more  enjoyment  and  willingness 
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t'  work  on  the  part  of  the  students,  and  the 
information  was  provided  in  a  variety  of  formats. 

All  but  one  of  the  teachers  indicated  that  their 
students  liked  leaning  chemistry  by  using  the  TLTG 
curriculum,  stating  as  reasons,  for  example,  that 
students  know  they 've  learned  more  than  non-lVD 
students,  that  the  visuals  helped  them  understand 
concepts,  that  they  could  participate  more,  that  it 
was  different,  and  that  it  stimulated  students' 
interest. 


/ic    With  regard  to  what  students  liked  the  best,  most 
(15  of  IS)  teachers  stated  that  the  students  liked  the 
computer  and  videodisc-based  games  and  simulations 
best.     Teachers  also  mentioned  that  students  liked  the 
small-group  activities,  the  teacher-pupil 
relationship,  the  visual  stimulation,  the  electronic 
instruction  (2),  the  immediate  feedback,  sound 
effects,  particular  units  and  topics,  and  practical 
applications  of  the  content. 

With  regard  to  the  major  difference    for  the 
teacher  in  using  the  curriculum,  teachers  mentioned  a 
greater  workload  during  this  first  year  (10  of  19), 
more  positive  interactions  with  students  (7),  that  it 
ride  teaching  less  stressful,  some  said  It  required 
more  preparation  time  while  others  said  less,  students 
learned  to  help  each  other,  and  that  it  made  the 
teacher  more  of  a  manager. 

Analysis  of  Videotaped  Classroom  Observations  and 
Staff  Visits  to  all^  School  Districts 

During  the  pilot  year,  five  teachers  were 
videotaped  conducting  their  classes  using  the  TLTG 
curriculum.     Preliminary  microanalysis  has  focused 
upon  the  behaviors  of  a  sample  of  fifteen  minutes  each 
of  the  classes  of  two  of  these  teachers.  Thes,e 
teachers  were  selected  because  they  were  both  using 
the  courseware  with  a  wh^  e-class  for  the  full  hour  of 
Cxass.     The  other  teache   j  were  using  the  courseware 
for  only  a  few  minutes  >- ^  were  using  the  systems  to  do 
small-grocp  labs.    Follow-up  analyses  are  planned  with 
the  other  classeT,  focujsing  upon  student  behaviors. 

When  using  the  teacher-led  portion  of  the 
curriculum,  teachers  can  comment  or  ask  questions 
about  the  content  presented  when  the  system  pause-  on 
a  frame.    These  pauses  occur  at  regular  intervals 
(approximately  every  30-40  seconds)  and  are  often 
accompanied  by  a  text  definition  or  question. 
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Teachers  can  also  contr'^i  svcst-em  nane/^c  u  ^ 

"STOP"  icon  nn  "  system  pauses  by  touching  a 

IhlJ'Vrl'fJ.^r"        initially  coded  as  to  whether 
iritll  lltt'^^ll  Se^^o°?Jo^li,"!""^'^- 
Teacher  Statements: 

"  thelLJc'^^sJf^         information  presented  by 
PA  -  T^LhoJ    system  to  new  information 
PA      Teacher  paraphrases  the  information 

IcM^    /^"''^^  ^^'^  student  to  do  some 
action  (for  example,  to  take  out  a  piece  of 
notepaper,  or  to  write  down  a  vocabSury 

''''  '  iTlhV'slTJ:."'^^'         information  presented 
oy  tne  system,  by  cueing  the  students,  for 

aSSr;  by  telling  them  to  notice  so^e  key 
attribute  of  a  concept.  ^ 
DES  -  Teacher  simply  desribes  what  is  on  tho 
screen 


Teacher-lnitiated  Quescions  of  Students: 

(Coded  first  by  whether  they  are  asked  of  whole 
class  or  of  an  individual  student) 

REC  -  Teacher  asks  students  to  simply  recall 
S  Ex  presented  by  system 

S.Ex      Teacher  asks  students  to  tell  Jheir  own 

examples  of  the  information  just  presented, 
EX  -    T^lcyZr^^^'^l^^  relevant  to  th^ir  oSn  liJes  ' 

extlnll  students  a  question  which 

rnl^^ti         information  presented  to  new 
HOW  -  5^^nK^^^'  information  or  examples 

Iraritl  ^^^^  students  how  a  phenomenon  or 
WHY  -  ?^?nh  '^^        the  system  occurs 

WHY      Teacher  asks  students  to  explain  why  a 

phenomenon  or  process  occurs 

lllttT^LT  ^°  Teacher-initiated 

(several  types  can  be  combined) 

KR  -  "Knowledge  or  Results  Feedback"  -  Teacher 

rfait  "'"^^"^^  whether  their  response  is 
right  or  wrong 

KCP  -  "Knowledge  of  Correct  Results"  -  Teacher 
tells  students  the  corrt  ;t  answer 
Teacher  provides  information  in  the  feedback 
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Student-Initiated  Comments  and  Questions: 


QU  -  Student  asks  teacher  a  question  (often 
answered  by  the  teacher  in  the  form  of 
another  question  and  then  feedback  to 
student's  answer) 
?So  ~  comments  on  something  teacher  said 

ANS  -  Student  answers  the  teacher's  question 

an;,iv!?r^f''^  teacher  observations  and  a  preliminary 
aSoit  Jh.  ^  ^V'^t  teachers,  as  a  rule,  made  statements 
about  the  content  or  asked  questions  when  the  system 
paused.    Teacners  rarely  used  the  stop  icon  i-o  stop 
the  program  themselves,  and  when  they  did,  it  was 
usually  done  to  repeat  a  video  special  effect,  rather 
than  to  clarify  a  point. 

When  commenting,   .eachers  generally  paraphrased 
ittlJ^l^  3ust  presented,  emphasized  mai^  points,  and 
extended  the  information,    when  asking  questions, 
.eachers  usually  asked  students  to  recall  what  was 
just  covered,  remember  prior  information,  and  apply 
n^L^T  ^°         situations,    when  an  answer  was 

posed  by  the  system,  teachers  repeated  the  question 
and  then  evaluated  the  student  answers.     Since  an 
answer  screen  usually  followed  a  question  screen  and 
sometimes  included  feedback  in  response  to  an  input, 
students  were  often  getting  feedback  twice. 

There  appear  to  be  two  types  of  teaching  styles, 
one  that  concentrates  on  dispensing  information  and 
one  that  focuses  on  seeking  information  from  the 

^'ho  are  dispensers  of  information 
spend  the  majority  of  class  time  clarifying, 
paraphrasing,  or  extending  the  information  provided  by 
the  courseware.    They  do  not  ask  many  questions  and, 
in  some  cases,  do  not  even  solicit  answers  from 
?n=!^^°!?K  sys.^.em,  preferring,  instead,  to 

answer  the  questions  themselves  cr  tell  students  that 
they  will  find  out  the  answer.    Teachers  who  are 
seekers  of  information  spend  much  of  the  class  time 
asking  students  to  recall  what  they've  just  seen  and 
heard,  to  apply  that  information  to  different 
examples,  or  to  make  inferences  about  a  situation  by 
connecting  tne  new  information  to  prior  knowledge. 
These  teachers  also  comment  on  the  material,  so  much 
intormation  is  exchanged  between  teacher  and  students. 

Plan  for  the  Field  Test  year  (1988-89)  Evaluation 

A  new  evaluation  plan  was  formulated  for  the 
field  test  year  of  the  TLTG  evaluation  (1988-^989).  A 
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team  consisting  of  TLTG  staff  members  and  university 
researchers  involved  are  collecting  data  regarding 
student  achievement  on  objectives-based  and 
standi rdized  achievement  tests,  and  regarding  student 
intention  to  enroll  in  science  courses  in  the  future, 
.his  electronic  curriculum,  however,  relies  heavily  on 
teacher  management,  integration,  and  delivery.  Since 
It  IS  not  a  "stand-alone"  individual-instruction 
curriculum,  actual  classroom  implementation  data  are 
critical  in  order  to  evaluate  the  real  effects  of  the 
interactive  videodisc  science  curriculum. 

Implementation  Study 

Data  regarding  the  actual  on-site  implementation 
of  the  TLTG  field  test  curriculum  are  being  collected 
to  answf-r  the  following  major  questions:  How  are  the 
students  and  teachers  using  the  curriculum  and  how  do 
they  feel  about  using  the  curriculum?  More  detailed 
questions  include: 

1)    What  are  the  student  and  teacher  attitudes  towards 
specific  instructional  design  aspects  of  the 
electronic  curriculum?    For  example: 

Students  -  what  do  students  like  and  dislike  about 
the  curriculum?    what  do  students  feel  helps  them 
the  most?    what  do  they  feel  confuses  them?  what 
makes  this  curriculum  unique  to  them? 

eachers  -  what  do  teachers  like  and  dislike  about 
whe  curriculum?    what  do  they  feel  helps  students 
learn  the  most?    How  do  they  feel  teachers  should 
be  trained  to  use  this  type  of  electronic 
IV      curriculum?    what  do  they  want  to  learn  now  about 
using  It?    How  do  teachers  believe  their  classroom 
role  are  changing? 

How  are  the  teachers  actually  implementing  the 
electronic  curriculum  in  their  classrooms? 
For  example. 

What  do  teachers  do  as  they  use  the  curriculum 
with  whole  classes,  with  small  groups  and  in 
incorporating  the  curriculum  with  wet  labs?  what 
do  teachers  use  and  not  use  in  the  curriculum,  and 
what  do  they  add  to  it? 

Otner  questions  related  to  teacher  behaviors  include 

A)  -  What  content  are  the  various  "electronic 
delivery"  and  "control  group"  teachers 
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2) 


teaching?  Does  the  content  differ  between  or 
within  groups?    if  so^  how? 


B)  -  What  activities  built  into  the  curriculum 
do  teachers  use?    How  do  these  differ  between 
the  teachers  who  are  using  the  i:eacher-only 
workstation  for  presentation  of  instruction^ 
and  tho3e  who  have  several  small-group 
workstations?    How  do  the  teachers  in  these 
two  configurations  handle  the  wet  labs  and 
simulated  lairs ^  as  well  as  computer  and 
teacher-delivered  practice? 

The  implementation  and  attitude  data  are  being 
collected  using  several  methods:  videotaped  classroom 
observations^  and  student  and  teacher  questionnaires 
and  interviews.    To  summarize: 


Data  sources  - 


Teachers  in  all  thirty  selected 
"experimental"  field  test 
classrooms,  students  in  a  sample  of 
about  six  of  these  classrooms 
(approximately  180 
students) . 


Instruments  - 


Procedures  - 


Student  and  teacher  questionnaires; 
interview  protocols  for  teachers  and 
students;  analysis  protocols  for 
videotaped  observations. 

Administration  of  student  and 
teacher  questionnaires  at  the  end  of 
each  semester;  teacher  and  student 
interviews  using  established 
protocols;  videotaped  observations 
conducted  in  sample  of  classrooms 
throughout  the  field  test  year. 


Discussion/Recommendations 

This  physical  science  curriculum  is  unique  in  the 
nation.     It  is  the  only  full-year  science  curriculum 
to  be  delivered  by  the  teacher  using  interactive 
videodisc  technology  in  both  whole  class  and  small 
group  configurations.      This  paper  described  the 
methodology  and  results  of  the  pilot  evaluation  of  the 
TLTG  curriculum,  conducted  during  the  1987-1988  school 
year  with  over  2000  students  and  twenty-five  teachers 
in  twelve  school  districts  in  Texas.    The  plan  for  the 
field  test  evaluation,  being  conducted  during  the 
1988-1989  school  year  with  over  five  thousand  students 
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and  thirty  teachers  in  four  states,  was  also 
described. 

The  effectiveness  of  the  interactive  videodisc- 
based  curriculum  in  teaching  chemistry  to  high  school 
students  was  demonstrated.    Evaluation  results 
indicated  that  students  who  used  the  TLTG  curriculum 
generally  learned  more  than  students  in  control-group 
classes  who  learned  chemistry  using  traditional 
methods,  as  measured  by  a  standardized  science 
achievement  test.     It  was  noted,  however  that  results 
were  not  consistent  for  students  of  varied  verbal  and 
quantitative  abilities.    Both  the  achievement  data  and 
tne  teachers'  perceptions  indicated  that  the 
IVD  curriculum  seems  td  be  more  effective  with  low- 
ability  students. 

Achievement  varied  considerably  by  teachers. 
Questionnaire  data  and  preliminary  analysis  of 
videotaped  classroom  observations  indicate  that  the 
teachers'  implement  the  curriculum  very  differently. 
For  example,  two  basic  teaching  styles  appear  to  be 
used  with  the  curriculum.     Some  teachers  seem  to 
simply  add  information  to  the  TLTG  presentations 
during  the  "pauses",  while  other  teachers  seem  to  use 
these  pauses  to  ask  students  questions,  provide  them 
with  feedback,  solicit  student-oriented  examples  of 
phenomena  learned  about,  and  initiate  discussions.  It 
is  hoped  that  daring  the  field  test  year,  the 
qualititive  study  will  yield  data  regarding  teacher 
behaviors  that  are  most  effective  when  using  a 
teacher-managed  electronic  curriculum,  such  as  this 
one. 

The  pilot  evaluation  results  indicate  that 
teachers  have  positive  attitudes  about  using  the  TLTG 
videodisc-based,  curriculum,  and  that  they  feel  their 
students  are  learning  more,  and  like  learning  better, 
when  using  the  electronic  curriculum.  Teachers 
indicated  that  using  the  curriculum  has  changed  the 
behaviors  they  engage  in,  as  well  as  their  role  in  the 
classroom.    They  also  indicate  that  students 
particularly  enjoy  the  interactive,  visual-based 
nature  of  the  curriculum,  especially  the  games  and 
simulations. 

Feedback  from  the  teachers  was  a  key  factor  in 
revising  the  design  of  the  TLTG  courseware.  Teachers 
indicated  that  they  want  the  technology  to  be  as 
transparent  as  possible,  so  they  can  concentrate  on 
the  content,  rather  than  the  technology.    To  this  end, 
several  features  have  been  designed  into  the  program. 
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One  feature  is  a  user  program,  which  allows 
teachers  to  load,  run,  and  erase  software  and  diagnose 
technical  problems  via  a  menu.    This  program  permits 
teachers  to  use  the  system  without  having  to  know  DOS 
structure  or  commands. 

Another  feature  is  a  menu  system  which  promotes 
smooth  navigation  through  the  courseware  and  easy 
access  to  lessons  or  practice  activities.    The  main 
menu  titles  are  related  to  topics,  with  each  topic 
branching  to  submenu  titles  tied  to  objectives.  Since 
teachers  may  not  get  through  a  whole  lesson  in  a 
period  or  may  want  to  review  parts  of  a  lesson,  a  user 
control  feature  was  designed  to  allow  teachers  to  skip 
ahead  in  small  chunks.    To  let  teachers  know  where 
they  are  in  the  system,  they  are  told  which  section 
was  3ust  completed  and  what  section  is  next.    They  can 
continue  or  go  to  the  main  menu. 

In  response  to  teachers'  request  that  the  program 
pause  often  to  allow  them  to  reinforce  points  or  check 
for  comprehension,  the  system  is  programmed  to  pause 
at  regular  short  intervals,  such  as  when  a  new  concept 
or  term  is  introduced.    Text  statements  or  questions 
are  provided  whenever  the  program  pauses  to  cue 
teachers  about  what  should  be  discussed  or  to  allow 
students  to  take  notes  about  the  information.  Since 
student  attention  was  observf;d  to  fade  after  about  two 
minutes  of  linear  video,  the  video  sequence  rarely 
runs  for  more  than  a  minute. 

Because  teachers  are  evaluated  on  how  often  they 
provide  constructive  feedback  to  students,  they 
preferred  to  inform  students  about  the  correctness  of 
their  responses,  rather  than  the  system. 
Consequently,  the  teacher-led  portion  of  the 
curriculum,  with  the  exception  of  the  teacher-led 
practice  activities,  does  not  include  many  places 
where  an  answer  is  entered  and,  therefore,  evaluated. 
However,  each  question  screen  is  followed  by  an  answer 
screen.  ^ 


The  pilot  year  evaluation  of  the  TLTG  curriculum 
has  several  implications  for  teacher  training  for 
classroom  use  of  technology.    Since  teachers  have  a 
great  need  to  become  comfortable  with  the  technology 
as  quickly  as  possible,  it  is  recommended  that  they 
have  a  lot  of  hands-on  time  with  the  IVD  system.  TLTG 
hands-on  sessions  during  teacher  traininq,  for 
example,  now  include  experiences  with  using  the 
videodisc  player,  loading  and  running  the  software, 
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breaking  down  and  setting  up  the  equipment,  previewing 

the  IVD  instruction,  and  planning 

lessons. 

To  demonstrate  the  adaptability  of  the  system  to 
different  teaching  styles,  it  is  advisable  to  show 
different  teachers  teaching  with  the  system.  TLTG, 
for  example,  invites  experienced  teachers  to  show  new 
project  teachers  how  they  teach  using  the  curriculum. 
If  it  can  be  shown  that  certain  teaching  styles  are 
more  effective  than  others,  recommendations  can  be 
made  to  teachers  about  what  works  when  teaching  with 
tne  courseware. 

Since  preliminary  reports  indicate  that  the  IVD 
system  works  well  v:ith  students  that  have  learning 
problems,  teachers  should  be  given  information  about 
how  they  can  use  the  courseware  effectively  with  this 
target  population. 

Finally,  it  is  recommended  that  in  evaluations  of 
videodisc-based  curriculum,  plans  be  made  to  include 
multiple  sources  of  data  collected  over  a  period  of 
several  years.    The  TLTG  curriculum  is  unique  not  only 
in  Its  design  and  yoals,  but  in  the  scope  of  the  field 
test  currently  oeing  conducted.    Results  of  the  field 
test  will  net  only  be  useful  in  designing  computer- 
assisted  interactive  video  for  science  instruction, 
but  for  developing  recommendationp  for  implementing 
other  interactive  video  curricula  in  the  schools. 
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WH\T  DO  TEACHERS  NEED  TO  KNOW 
ABOUT  INSTRUCTIONAL  MEDIA  IN  THE  COMPUTER  AGE? 


Introduction 

Most  teacher  credential  programs  nationally 
include  training  in  use  of  technology:  such  training 
is  in  many  cases  mandated.    Accreditation  requirements 
also  often  dictate  the  inclusion  of  such  training.  A 
recent  task  force  of  the  Associatio:   for  Educational 
Cuffimunications  and  Technology  has  r. .ommeided  that 
instructional  technology  skills  and  knowledge  be 
included  in  teacher  training. 

Yet  there  is  little  agreement  as  to  what  such 
training  should  include.     Trends  in  technology  use  in 
education  are  reflected  in  the  change  of  the  field's 
very  name,  from  "audio-visual  education"  through 
"media  education"  to  the  current  name,  "educational 
technology."    Many  universi^jy  courses  have  remained  in 
the  dark  ages  by  continuing  to  teach  student  teachers 
old  technologies  which  are  no  longer  useful  in  the 
field  or  to  teach  skills  which  are  no  longer  relevant, 
while  ignoring  technologies,  for  example,  like 
computers  for  graphics,  or  interactive  video,  which 
are  changing  the  nature  of  U.S.  education. 

There  is  relative  agreement  that  the  use  of 
technology  in  classrooms  can  and  will  change  the  role 
of  both  teachers  and  media  specialists  in  the  schools « 
Technologists  have  stressed  the  teaching  of  principles 
of  technology  use  in  addition  to  practices  (Gagne, 
Brings,  &  Wager,  1988;  Heinich,  Molenda  &  Russell, 
1965;  Knirk  &  Gustafson,   1986).     Such  principles,  for 
example,  th?je  involved  in  selecting  appropriate  media 
for  given  objectives  and  situations,  can  be  effectivly 
taught  in  basic  technology  courses  (Higgins  &  Reiser, 
1985).     Other  technologists  have  noted  that  technology 
training  and  use  must  take  into  consideration  the 
realities  of  school  situations  (Heinich,  1984.)  All 
agree  that  technology  training  must  continually  change 
to  reflect  the  impact  of  new  tichnologies.     It  also  is 
clear  that  teacher  input  and  "ownership**  as  well  as 
administrator  support  are  critical  in  successful  u^e 
of  educational  technology. 

This  paper  describes  the  results  of  a  research 
study  which  investigated  teacher  training  needs 
related  to  effective  use  of  technology  in  the 
classroom.     The  study  was  conducted  to  help  improve  a 
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etate-required,  1-credit  media  competency  course  taken 
by  approximately  250  teacher  credential  candidates  per 
eemeeter  at  a  major  California  university.    The  course 
is  offered  in  several  formats,  normally  once  a  week 
for  six  weeks,  or  two  weekends,  or  in  shorter  classes 
o\ iv  eight  weeks.     The  course  introduces  teachers  to 
systematic  design  of  instructional  materials;  how  to 
write  student  learning  objectives  and  lesson  plans 
based  on  Gagne's  (1977)  nine  events  of  instruction; 
media  equipment  operation;  production  of  dittos, 
overhead  transparencies  and  laminated  visuals;  media 
selection,  basic  instructional  video  production;  and 
an  introduction  to  educational  computer  software 
evaluation. 

Methodology 

QueationR 

Data  were  collected  related  to  the  current  and 
anticipated  technology  training  needs  of  teachers  in 
classrooms  in  a  large  California  metropolitan  area. 
Data  were  collected  to  answer  questions  in  the 
following  areas: 

1)  Entry-level  technology  skills  of  teacher 
credential  candidates.    What  technologies  do 
credential  candidates  come  into  their  programs  knowing 
about?    What  instructional  materials,  such  as 
videotapes  and  overhead  transparencies,  have  they 
produced?    What  percentage  of  them  already  know  how  to 
operate  certain  equipment,  such  as  16mm  projectors  and 
microcomputers? 

2)  Final  evaluations  of  the  skills  they  learned 
in  the  media  course  by  students  finishing  the  course. 
What  do  credential  students        :eive  as  the  most,  and 
least,  valuable  skills  they  learned?    What  did  they 
enjoy  the  most,  the  least,  and  why? 

3)  Perceived  needs  of  new  teachers  in  the  field. 
What  technology  related  skills,  which  new  teachers 
learned  in  their  credential  programs,  do  they  feel 
help  them  teach  most  effectively?      What  do  these  new 
teachers  wish  they  had  learned  about  technology? 

4)  Perceptions  of  teacher  education  leaders. 
What  do  teacher  educators  believe  teachers  should 
learn  in  order  to  teach  effectively  using  technology? 
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Procedures  and  Instruments 


Data  were  collected  using  surveys,  primarily  in 
teacher  education  courses  at  a  major  university  campus 
and  at  field-based  education  sites. 

Survey  Ol  tl&dia  Skills  ^xi^  Ooinione  of,  Tncoming 
Teacher  Credential  Candidates.     As  part  of  the  normal 
data  collection  procedure  for  the  course  (EDTEC  404) 
during  the  spring  semester  of  1988,  161  teacher 
credential  candidates  completed  a  questionnaire 
retiarding  their  experience  with  using  and  producing 
media  materials  on  the  first  day  of  their  attendance 
in  the  course, 

End-of-Course  Evaluations.     During  both  the  fall, 
1987,  and  spring,  1988  semesters,  467  teacher 
credential  candidates  completed  an  end-of-course 
questionnaire  to  determine  the  students'  perceptions 
regarding  the  skills  and  knowledge  about  instructional 
media  which  they  learned  in  the  course. 

Opinions  Ol  tkll  Teachers  ^  gxi^  Xhi^ 

First  Year  Teaching.     Twenty-two  of  twenty-five 
first-year  elementary  teachers  participating  in  a  new 
teacher  retention  project  completed  a  questionnaire 
regarding  their  perceptions  of  the  value  and  utility 
of  the  media  skills  they  learned  in  their  teacher 
preparation  program. 

Opinions  qS.  Teachqy  Education  Leaders.  Seven 
leaders  of  the  elementary  teacher  education  blocks 
completed  a  questionnaire  regarding  the  education il 
media  currently  available  in  the  schools,  the  utility 
and  value  of  what  their  credential  students  were 
learning  about  media,  and  their  opinions  regarding 
what  teachers  need  to  know  about  instructional  media 
now  and  five  years  from  now. 

Results 

Survey  Ol  tkdl^  Skills  Opinions  ot  Incoming 

l±f:Qh&  -  Credential  Candidates .     Of  the  161  students 
who  completed  the  pre-course  questionnaire,  103  (64%) 
had  some  experience  producing  instructional  media, 
while  59  (37%)  did  not.     Of  all  161  students,  most  had 
produced  dittos  (136,  84%),  and  43  (27%)  had  produced 
overhead  transparencies.     Many  students  (29,  18%)  had 
also  produced  laminations  and  flyers  or  brochures. 

Of  these  students,  124  (77%)  had  used  computers, 
while  30  (19%)  had  not.     The  software  most  commonly 
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used  was  a  word  processor  (82,  51%),  followed  by 
entertainment  games  (6C,  3735)  and  educational  gaiues 
(49,  30%).    Many  students  (40,  25%)  had  used  a 
programming  language,     f^me  students  had  used  other 
types  of  software,  such  as  spreadsheets  and  data-base 
packages,  as  well. 

When  asked  how  these  preservice  teachers  hoped  to 
use  what  they  learned  in  the  media  course,  half  the 
students  indicated  they  hoped  to  enhance  their 
teaching  by  using  media  as  teaching  aids,  34  (21%) 
mentioned  they  would  produce  instructional  media  and 
visual  aids,  and  15  (9%)  hoped  to  become  mroe 
proficient  at  use  of  equipment. 


End-of-CQUrge  Emluati^Ulfi..    Final  course 
evaluations  indicated  that  68%  of  the  476  students  who 
completed  the  evaluations  strongly  agreed  or  agreed 
that  they  liked  the  course,  while  86%  said  they  would 
ual  what  they  learned  in  the  course  in  thaii  reaching. 
They  mentioned  such  exa»aples  of  uses  as  overheads  (51, 
11%),  video  (48,  10%)  and  dittos  (41,  9%). 

Students  indicated  that  they  felt  learning  to 
produce  dittos  (206,  43%)  and  overhead  transparencies 
(146,  31%)  were  the  most  useful  skills  they  learned, 
followed  by  video  production  (95,  20%),  followed  by 
media  selection  (89,  19%)  and  lamination  (74,  16%). 
They  perceived  video  {121,  25%)  and  lamination  (67, 
14"^)  as  the  least  useful  skills  for  their  teaching. 

The  topic  students  t.njoyed  the  most  was  video 
production  (282,  59%),  followed  by  the  "hands-on" 
experience  (70,  15%),  computers  (39,  8%),  and 
lamination  (28,  P%).     Reasons  they  gave  for  their 
choices  were  that  these  topics  were  fun  (123,  26%), 
they  enjoyed  working  in  groups  (45,  9%)  and  the 
creativity  involved  (41.  9*).    Topics  students,  enjoyed 
the  least  were  the  lectures  and  theory  (87,  18%), 
dittos  (33,  7%),  and  media  selection  (26,  5%).  They 
indicatiii  they  did  not  enjoy  dome  topics  because  they 
were  borag  or  redundant  or  because  the  limited  time 
in  the  course  made  it  difficult,  frustrating  or 
unenjoyuble  to  learn  these  topics. 


Qpinlona  OL  Han  TeacherB  at  tJa&  ^^lli  Ol  Their 
ElcSJt.  IsiAXl  Teanhln?      The  twenty-two  first-year 
teachers  described  the  media  they  had  used  and 
produced  during  the  past  year.    Dittos  were  the  most 
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commonly  used  medium,  with  18  (82%)  of  the  teachers 
having  used  them,  and  17  (77%)  having  produced  them. 
Other  commonly  used  media  were  filmstrips  (18,  82%), 
videotapes  (17,  77%),  audiotapes  (17,  77%),  and 
overheaas  (13,  59%).    Teachers  reported  having 
produced  laminated  pictures  (16,  73%),  overheads  (9, 
41%),  mounted  pictures  (7,  32%)  and  photocopies  (4, 
18%).     Only  2  of  the  teachers  (11%)  had  produced 
videotapes  or  audiotapes. 

Computers  were  used  in  the  classrooms  of  13  (59%) 
of  the  teachers,  mostly  for  educational  games  (11, 
50%),  word  procos  ing  (6,  27%),  entertainment  games 
(6,  27%),  and  CAI  programs  (6,  27%). 

These  new  teachers  felt  the  most  useful  media 
skills  they  had  learned  were  using  the  thermofax, 
lamination,  and  dittos  (4,  18%  each),  followed  by 
overhead  transparencies,  and  using  the  16mm  projector 
(3,  14%  each).    Least  useful  was  video  (2,  11%), 
Two  teachers  (11%)  said  all  skills  they  learned  were 
useful . 

The  new  teachers  most  wanted  to  learn  about 
computers  (9,  41%),  video  (4,  18%),  and  16mm  film 
projectors  (2,  11%).    Other  topics  mentio.ied  were 
videodiscs  and  interactive  video    slides,  xapes, 
and  telecommunications. 

When  asked  how  educational  technology  would 
change  teaching  in  five  years,  these  teachers 
mentioned  that  it  would  expand  studeits'  experiences, 
help  individualize  learning,  and  provide  help  through 
new  communications  media  (7,  32%).    Many  also  said 
there  would  be  more  "high  technology"  and  more 
computers  (7,  32%),  and  that  technology  would  make  it 
easier  for  teachers. to  manage  and  organize  instruccioh 
(4,  18%). 


Qplniong  q£  Teanher  Education  Iifiad^Tfi..     The  seven 
teacher  education  block  leaders  indicated  that  all  of 
t^eir  field  site  schools  (about  ten  elementary 
pohools)  had  16mm  projectors,  ditto  machines  and  video 
recorders,  and  that  most  had  video  cameras,  thermofax 
machines,  opaque  projectors  and  35mm  slide  projectors. 


All  teacher  educators  indicated  that  they  teach 
objective  writing  and  lesson  planning,  with  a  five  or 
sevv^n-step  clinical  model,  and  most  agreed  that  they 
preferred  these  topics  not  be  taught  in  the  media 
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courses,  however  they  did  indicate  that  the  media 
courses  should  "nesh"  with  what  is  taught  in  lesson 
planning. 

The  teacher  educators  indicated  that  in  a  media 
course  teacher  credential  students  should  be  taught 
selection  and  management  of  media,  computer  skills, 
video  use,  basic  equipment  operation  and  how  to  use 
blackboards  and  other  visual  media. 

In  five  years  they  felt  teachers  would  also  need 
to  know  how  to  use  microcomputers,  the  management  and 
creative  use  of  technology,  strategic  planning,  grant- 
writing,  how  to  get  equipment  and  curriculum  alignment 
skills 

Discussion 

The  results  of  this  study  indicate  that  both 
preeervice  and  in-service  teachers  value  learning 
about  production  and  use  of  media  and  materials 
cor-^only  av&xlablu  in  their  schools,  such  as 
blackboards  I  dittos,  overheads,  mounted  pictures, 
laminations,  and  use  of  projectors.     Yet,  it  appears 
from  the  pre-course  survey  that  many  students  already 
have  learned  these  skills  before  they  enter  the 
required  media  course.     Since  the  skills  are  perceived 
as  valuable,  they  should  still  be  addressed,  but  there 
are  alternative  means  for  teaching  these  skills. 
Self- instructional  modules,  with  test-out  and  mastery 
tests,  would  be  one  method  for  providing  students  with 
these  skills,  vhile  leaving  valuable  class  time  to 
pursue  topics  students  indicate  are  important  or  very 
enjoyable,  but  which  are  not  given  enough  time  in  the 
brief  required  course,  topics  such  as  media  selection, 
aud  use  of  video.     Topics  which  students  already  know, 
such  as  dittc-*,  could  be  addressed  in  terms  of  lesson 
planning  in  t^e  teaching  methods  courses. 

As  a  result  of  these  results,  several  revisions 
were  recommended  for  the  EDTEC  404  course. 
Information  about  use  of  chalkboards  and  other 
visual  presentation  media  was  added  to  the  course.  It 
was  recommended  that  class  time  not  be  spent  on 
objectives  and  lesson  plan  writing,  with  students 
being  able  to  write  objectives  and  lesson  plans  for 
media  use  and  selection  using  any  of  the  formats  they 
used  in  their  methods  courses. 

While  computer  skills  were  mentioned  as  being 
valuable  both  now  and  in  the  future  by  al*. 
pai?ticipants,  the  state-mandated  three  course 

176 

7 


educational  computing  sequence  will  provide  students 
with  intense  hands-oa  experience  with  computers  for 
instruction.     It  was  recommended  that  the  unit  on 
video  be  expanded  to  allow  students  time  to  accomplish 
mastery  and  achieve  more  satisfaction  with  the  basic 
video  production  skills.     It  was  also  recommended  that 
the  CAI  software  evaluation  unit  be  replaced  by  a  "new 
technologies"  unit,  introducing  students  to  such 
technologies  as  interactive  video,  CD-ROM,  and 
telooommunications,  and  such  a  unit  was  developed  and 
is  being  implemented. 

With  the  great  need  for  teachers  who  are  adept  at 
performing  the  multiple  roles  required  of  them  when 
they  use  the  power  of  technology  in  their  classrooms, 
instructional  media  technologry  courses  can  provide  an 
opportunity  for  teachers  to  become  "empowered" 
themselves.    This  study  indicates  that  preservice,  and 
inservice  teachers  and  their  educators  recognize  the 
dual  need  to  be  skilled  at  basic  media  use,  while 
preparing  themselves  to  skillfully  use  the  new 
technologies  to  enhance  their  students'  learning. 


References 


(iagne,  R.  M.  Ui£  condltiona  fif  learning  (4th  ed.).  New 
York:  Holt,  Rinehart,  and  Winston. 

Giigne,  R.  M.,  Briggs,  L.  J.,  &  Wager,  W.  W.  (1988). 

PrinclplfiB  qI  inatrnGtiQnal  design  (2nd  edition). 
New  York:  Holt,  Rinehart  and  Winston. 

Heinich,  R..(1984).  The  proper  study  of  instructional 
technology.     ECTJ,  32(2),  67-87. 

Heinich,  F:.,  Molenda,  M.,  &  Russell,  James,  D.  (1985). 
Instructional  media  and  the  new  technologieg  of 
inatruGtinn  (2nd.  ed.).  New  York:  John  Wiley  and 
Sons. 

Higgins,  N.,  &  Reiser,  R.  A.  (1985).  Selecting  media 
for  instruction:  an  exploratory  study.  Journal 
SdL  inatructlonal  development,  £L(2),  6-10. 

Knirk,  F.  G.,  &  Gustafson,  K.  L.  (1986).  TngtructMnnal 

New  York:  CBS  College  Publishing  of  Holt, 
Rinehart  and  Winston. 


t77 

»  470 


Title: 


A  Short  Note  on  Rules  and 
Higher  Order  Rules 


Author: 


Joseph  M.  Scandura 


479 


471 


A  Short  Nolo  on  RuIm  and  Hightr  Order  Rules 

Joseph  M.  Scandura 
University  of  Pennsylvania 

Having  introchjced  the  concept  of  higher  order  rules  in  our  research  over  two  decades  ago.  it  is 
truly  gratifying  to  see  these  concepts  pla/ing  such  a  central  role  in  contemporary  thinking  and 
research  on  cognition.  ( Back  in  the  1 960's  and  1 970's.  most  leading  researchers  tended  to  view 
higher  order  Icnowledge  as  the  integration  of  components  -  either  of  S-ft  associations  or  of  lower 
order  rules.)  For  example,  Perlcins  and  Salomon's  ( 1989)  arguments  to  the  effect  that  both 
domain  specific  and  content  Independent  knowledge  are  needed  to  explain  cognitive  behavior  falls 
In  this  category  as  does  Brown,  Collins  and  Duguids's  ( 1989)  argument  that  "culture"  has  as 
signll  luant  an  effect  on  such  behavior  as  does  explicit  information. 

While  this  is  not  the  place  to  develop  sue''  issi<es,  some  brief  comments  and  cautions  seem  m 
order;  Parkin's  and  Salomon's  analysis  suggests  that  one  can  usefully  distinguish  knowledge  that 
is  domain  dependent  and  knowledge  that  is  domain  Independent,  in  effect,  they  too  agree  that 
general  cognitive  skills  (higher  order  rules)  operate  on  specific  knowledge  (lower  orier 
rules).  It  Is  Important  to  note,  however ,  that  structural  analysis  (an  extended  form  of  cognitive 
task  analysis)  demonstrates  that  Mft  kinds  of  knowledge  can  be  derived  from  specific  content 
domains.  The  major  difference  is  that  lower  order  rules  are  derived  directly  from  specific 
domains  (and  represented  as  lower  order  rules).  Higher  order  rules  are  derived  indirectly  via 
structural  analysis  of  rules  obtained  at  earlier  stages  of  analysis  (see  Scandura  et  a),  1974. 
1982,  1984). 

Highflf  order  knowledge,  historically,  has  been  viewed  as  content  independent  (e.g..  Polya, 
1%0)  but.  In  fact,  such  independence  has  alwa/s  been  a  matter  of  degree.  Compare  Polya's 
( 1 960)  Informal  discussion  of  heuristics  and  Scandura,  Durnin  and  Wulfeck's  ( 1 974)  analysis 
which  represents  Polytfs  heuristics  explicit  higher  order  rules.  Empirical  tests  arid 
computer  simulations  have  demonstrated  both  the  validity  and  precise  scope  of  applicability 
( 1  e ,  transferability)  of  such  rules,  indeed,  it  is  very  hard  to  come  up  with  knowledge  which  is 
completely  independent  of  content.  Even  meens-entb  analysis  (eg.,  Newell  &  Simon.  1972), 
for  example,  cannot  be  uniformly  assumed  as  a  common  method  for  solving  problems.  Earlier 
research  empirically  demonstrates  its  lack  of  uniform  availability  (e.Q..  Scandura.  1971. 
1974,  1977,  esp.  pp.248- 50).  All  higher  order  knowledge,  except  for  a  very  simple  goal 
switching  control  mechanism ,  appears  in  some  degree  to  be  tied  to  content 

The  importance  of  cultural  (or  incidental)  knowledge  in  cognitive  behavior  can  be  viewed  in  a 
similar  manner.  It  is  not  that  some  knowledge  cannot  be  represented  explicitly.  It  is  simply 
that  Identifying  such  knowledge  is  more  '«fflcult  For  example.  It  is  difficult  to  reduce  the 
acquisition  of  Piagetian  conservation  behavior  to  instruction  on  simple  rfjles  —  because  the 
knowledge  assniated  wltr^  concrete  operations  is  so  relatively  complex  and  has  <<uch  a 
fundamental  Impact  on  the  btihavlor  of  young  children.  This  does  not  mwn,  nowever .  that  such 
knowledge  cannot  be  made  explicit.  An  example  of  this  is  Scandura  and  Scandura  s  (1980) 
analysis  of  Piagetian  conservation  In  terms  of  explicit  highw  and  lower  order  rules. 
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SATELLITE  COMMUNICATION  AND  HIGH  SCHOOL  EDUCATION 

PerceptionL  of  Students,  Teachers,  and 
Administrators  Toward  the  Use  of 
Satellite  Technology  for  Distance  Education 


Comnunications  satellites  in  geosynchronous  orbit  above  the  earth  in  a 
hcrizon-to-horizon  band  called  the  Clarke  Belt  are  routinely  used  to  sen*l 
televised  high  school  courses  to  schools  throughout  the  United  States. 
Courses  such  as  calculus,  physics,  and  Japanese  are  being  uplinked  and  relayed 
by  satellites  to  high  schools  dispersed  hundreds  and  even  thousands  of  miles 
from  originating  site3.    These  courses  are  a  regular  component  of  the 
curriculun  of  the  schools  where  they  are  received,  even  though  students 
usually  miver  see  their  "satellite"  teacher  or  meet  in  a  traditional  classroom 
situation  (Barker  and  Bechner,  1986). 

Use  of  satellite  technol^^gy  for  the  delivery  of  regular  high  school  course 
work  is  projected  to  increase  as  rural  schools  continue  to  decline  in 
enrollment,  and  as  standards  for  the  approval  of  school  curricxila  become  more 
demanding  (Barker,  1987).    The  U.S.  Congress  has  even  approved  $20  million  for 
the  development  of  the  STAR  SCHOOLS  Program  which  will  fund  the  development  of 
regional  satellite  uplink  systems.    Ihe  purpose  of  these  "satellite  star 
school  centers"  would  be  to  deliver  mathematics,  science,  and  foreign  language 
courses  to  any  school  where  such  courses  were  needed  (Federal  Register,  19^8). 

nirpoBes  of  the  taper 

This  paper  will  discuss  three  research  studies  evaluating  the  use  of  satellite 
technology  when  it  was  used  for  the  delivery  of  high  school  courses.  These 
studies  were  completed  during  1988. 

smuf  #1:    This  study  evaluated  the  perceptions  of  school  superintendents 
concerning  the  use  of  satellite  technology  to  deliver  high  school  courses  for 
credit.    Four  research  questions  were  examined. 

1.  What  was  the  current  status  of  the  use  of  satellite 
technology  in  their  school? 

2.  What  were  the  attitudes  held  by  superintendents  toward  the 
use  of  satellites  to  deliver  high  school  courses  for  credit? 

3.  What  were  their  school's  irai»^diate,  short-term  plans 
for  the  use  of  satellite  technology? 

4.  How  should  satellite  courses  be  administered? 

Specifically,  what  courses  are  needed,  how  1^'^"  should  couurses 
last,  how  should  courses  be  graded,  and  how  much 
should  satellite  courses  cost? 
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Superintendents  were  given  background  information  about  satellite  technology 
in  the  survey  foitn  they  comoleted.    TVo  follow-up  mailings  were  sent  to  non- 
responders  to  ensure  a  high  rate  of  return.    All  A36  superintendents  employed 
in  Iowa  during  1988  were  sent  the  survey. 

SBMK  #2:    Currently,  several  organizations  are  offering  satellite  courses  for 
credit.    The  largest,  the  TI-IN  network  which  originates  its  courses  near 
Houston,  TX,  offers  a  nearly  complete  high  school  curriculum,  and  a 
considerable  number  of  enrichment  activities  to  supplement  its  courses  for 
credit.    Over  200  schools  in  15  states  subscribe  to  the  TI-IN  satellite 
network,  and  enroll  their  students  in  TI-IN  courses  (Barker,  1987). 

Since  the  TI-IN  network  offered  the  most  comprehensive  secondary  school 
program  using  satellite  technology,  its  students  were  targeted  for  Phase  II  of 
this  project.    Twenty-four  school  districts  from  a  half  dozen  states  (Texas, 
Iowa,  Kansas,  Vfest  Virginia,  Michigan,  and  Calif omj.a)  were  randomly  selected 
from  a  list  of  TI-IN  subscribers.    The  superintendents  of  these  schools  were 
called  and  asked  if  they  wouJ.d  allow  TI-IN  students  to  respond  to  an  anonymous 
questionnaire  dealing  with  their  opinions  about  learning  over  the  satellite 
network.    Eight  research  questions  were  used  as  the  basis  for  the  development 
of  the  questionnaire  sent  to  these  students. 

1.  Wliat  are  the  characteristics  of  students  enrolled  in  satellite 
courses? 

2.  Why  have  students  elected  to  enroll  xn  satellite  courses? 

3.  What  are  the  students'  perceptions  of  the  strengths  and  weaknesses 
of  interactive  satellite  instruction? 

A.    Hdw  do  students  view  the  difficulty  cf  satellite  courses? 

5.  From  the  students'  perspective,  do  satellite  courses  offer  other 
benefits  beyond  ^ourse  content? 

6.  From  the  students'  perspective,  do  satellite  courses  provide  a 
sufficient  level  of  interaction  between  students  and  teachers? 

7.  What  ideas  do  students  have  that  would  improve  satellite 
instruction? 

8.  To  what  degree  do  students  support  satellite  instruction? 

SmV  #3:    Since  distance  education  in  general,  and  satellite  course  delivery 
specifically,  have  implications  for  both  teachers  and  administrators,  the 
third  part  of  this  project  was  designed  to  obtain  opinions  from  leaders  of 
teacher  and  school  administrator  organizations.    Specifically,  the  current 
presidents  of  the  fifty  state  teacher  organizations  and  the  presidents  of  the 
fifty  state  associations  of  school  administrators  were  questioned  concerning 
their  attitudes  toward  the  use  of  satellite  technology  to  deliver  high  school 
courses . 
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A  questionnaire  was  sent  to  each  of  these  leaders.  The  questions  included  in 
the  survey  produced  data  related  to  these  four  research  questions. 

1.  Is  the  use  of  satellites  to  deliver  courses  to  high  school  students 
an  appropriate  idea? 

2.  Will  the  widespread  use  of  satellite  technology  have  a  positive 
impact  on  the  teaching  profession? 

3.  Will  the  school  curriculum  be  effected  positively  by  the  use  of 
satellite  techno? ogy? 

A.    Are  adequate  controls  included  when  satellite  courses  are  planned 
and  delivered,  in  order  to  maintain  quality  of  content? 


Background 

This  study  surveyed  all  of  Iowa's  school  superintendents  to  query  them  about 
their  receptiveness  to  the  use  of  satellite  technology  for  the  delivery  of 
junior  and  senior  high  school  courses.    A  survey  form  was  developed  and  mailed 
to  436  Iowa  superintendents.    TVo  hundred  sixty-one  (261)   were  returned.  A 
second  mailing  was  sent  to  the  175  who  had  not  responded.  Sixty-seven 
responded  to  the  second  mailing.    The  return  totaled  328  (75.2%).  Responses 
from  all  areas  of  the  state  were  received. 

Those  who  responded 

The  average  daily  attendance  of  the  schools  who  responded  was  900.  Two 
hundred  thirty- three  (233)    of  those  responding  indicated  that  their 
enrollments  were  declining,  and  37  indicated  rising  enrollment  trends.  Seventh 
through  eighth  grade  was  the  most  prevalent  junior  high  school  organization 
(147  of  those  responding,  44%),  and  9-12th  grades  was  che  most  common  high 
school  organizational  pattern  (261  of  those  responding,  77%). 

Ninety-one  (27%)  of  the  superintendents  who  responded  said  that  their  schools 
were  in  comrninities  of  less  than  1,000  population.    Two  hundred  ten  (210) 
superintendents  (62%)  indicated  their  communities  ranged  between  1,000  and 
10,(X)0.    TWenty-five  schools  (7%)  from  which   superintendents  responded  were 
from  cities  larger  th£ui  50,000. 
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Study  §1  -  j  j^  il:    Status  of  Safj»1H»«.  i^e 


Twenty  (5.9%)  superintendents  indicated  their  schools  currently  owned 
satellite  reception  systems.    Seventy-eight  (23%)  stated  they  had  plans  to 
install  systems  in  the  inmediate  future. 

Twelve  superintendents  said  they  were  subscribers  to  TI-IN,  the  commercial 
satellite  course  delivery  network.    Thirty-one  superintendents  indicated  that 
they  were  definitely  considering  subscribing  to  TI-IN.    Twenty-one  said  they 
were  interested  in  subscribing,  and  eighty-seven  said  they  were  unsure.  One 
hundred  twenty-seven  (127)  were  definitely  not  interested  in  TI-IN.  Responses 
to  this  question  were  correlated  to  the  perceived  benefits  superintendents 
felt  could  be  derived  from  using  satellites  to  deliver  courses  (r=.A3)  and  to 
the  question  about  the  appropriateness  of  the  use  of  satellites  to  deliver 
courses  (r=. 39).    In  other  words,  those  superintendents  v^o  where  considering 
subscribing  to  TI-IN  were  likely  to  be  positive  about  the  benefits  of  this 
kind  of  course  delivery.    Certainly,  this  was  to  be  expected.    What  was 
somewhat  unexpected  was  that  f.he  superintendents  who  felt  this  way  did  not 
tend  to  be  from  any  particular  size  of  community  (small  or  large). 

Study  fl  -  Bart  #2;  Attitudes  held  by  Superintendents 
about  Satellite  Tedmolo^ 

Knowledge  About  Satellite  Technology 

In  general,  superintendents  considered  themselves  not  to  be  very  knowledgeable 
about  satellite  technology.    Only  ten  felt  they  "knew  a  great  deal,  "  and  only 
65  felt  they   knew  quite  a  bit".    One  hundred  thirty-five  (135)  said  they  knew 
a  little.    The  correlation  between  answers  to  this  question  and  the  question 
that  asked  about  knowledge  of  TI-IN  was  a  highly  significant  one  (r=,60), 
r^^,  superintendents  who  knew  about  satellites  also  knew 

about  TI-IN  and  vice-versa. 

Superintendents  said  they  learned  about  satellite  technology  from  reading 
Tlul'  ^"S^^ice  sessions  (1^135),  and  vendors  (N=2A).    Ftorty-eight  percent 
ot  the  superintendents  considered  tU.c  they  were  the  most  knowledgeable  person 
in  their  school  concerning  satellites.    Other  knowledgeable  persons  were 
principals  (12%)  and  media  specialists  (11%).    Nineteen  percent  of  the 
superintendents  said  no  one  in  their  school  was  knowledgeable  about 

Perceptions  About  Satellite  Delivery  of  Courses 

Oie  hundred  eighty-one  of  the  superintendents  (5A%)  reported  that  they  saw 
value  in  the  use  of  satellite  technology  to  deliver  courses  for  credit.  Two 
hundred  eighteen  (65%)  said  they  would  allow  students  in  their  schools  to  take 
courses  delivered  by  satellite. 
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Superintendents  seemed  most  positive  about  the  use  of  hcnne  state  teachers  as 
part  of  a  statewide  system  of  satellite  course  delivery.    One  hundred  and 
ninety  said  they  would  consider  subscribing  to  such  a  system  (56%).  Only 
twenty  (6%)  were  opposed  to  subscribing.    Responses  to  this  question  were 
significantly  correlated  to  answers  to  questions  asking  about  perceived 
benefits  of  using  satellites  (r=.61)  and  about  acceptance  of  the  idea  of  using 
satellites  (r=.57). 

When  asked  about  who  should  teach  satellite  courses,  local  state  certified 
teachers  were  rated  highest  (82%  positive),  out-of-state  certified  teachers 
were  rated  second  (5A%),  professors  rated  third  (50%  positive),  and  certified 
graduate  students  were  rated  least  positively  (AA%). 

One  important  question  in  this  section  of  the  survey  asked  "do  you  think 
courses  for  jxinior  and  senior  high  school  students  should  be  taught  using 
satellite  delivery  systems?"    It  was  answered  positively  by  218 
superintendents  (65%).    Only  fifty-two  superintendents  (15. A%)  indicated  that 
they  were  strongly  or  somewhat  opposed  to  the  use  of  satellites  to  deliver 
courses . 

Teacher  and  Teacher  Organization  Reactions  to  Satellites 

Superintendents  felt  that  their  teachers  would  positively  react  to  the  use  of 
satellite  delivery  systems  (156  yes;  57  no).    They  were  also  asked  to  assess 
the  local  teacher  organization's  reactions  to  the  use  of  satellites. 
Superintendents  felt  that  teacher  organizations  would  react: 

Very  Negatively  =  8 
Negatively  =  70 
Neutrally  =  6A 

Positively  =  85 
Very  Positively  =  5 

Study  #1  -  Byt  #3:   iMsdiate  Plans 
far  Dae  of  Satellite  Tbcfapology 

As  was  stated  earlier,  twenty  superintendents  reported  that  their  schools 
c  med  satellite  reception  systems,  and  78  said  they  planned  to  purchase 
satellite  receivers  in  the  near  futurt.    Several  superintendents  (twelve^ 
stated  that  they  planned  to  purchase  more  than  one  system. 

The  RF  frequencies  received  by  those  systems  already  installed  were  split 
about  in  thirds.    One-third  were  C-band,  one-third  were  Ku-band  and  one-third 
f  the  systems  were  capable  of  receiving  both  bands. 

Thirty-one  superintendents  said  "yes"  they  were  contemplating  subscribing  to 
TI-IN  (an-wered  5  on  a  5-point  scale).    The  total  number  of  positive  responses 
to  this  question  was  139  (A2;^). 

A  related  question  asked  the  superintendents  if  they  would  consider 
subscribing  to  a  satellj.te  system  if  it  originated  in  their  home  state.  Che 
hundred  ninety  (58%)  said  they  would  consider  subscribing  (A3=definitely  yes; 
lA7=yes),  and  123  were  unsure.  Only  one  superintendent  chose  the  definitely 
not  option. 
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Table  1.    Attitudes  of  Students  Towards  Satellite  Instruction 


Highest 

Number  Range       Mean  possible  Reliability 

Subtest  responding    of  scores    score  *      SD       score       of  subtest 


Strengths  of 
satellite 

instruction  290  7-49        31.64       7.06  55  .76 

(2.88)  (.64) 

Adequacy  of 
interaction 

level  290  3-40        25 . 75       5 . 33  40  .72 

(3.22)  (.67) 

Benefits  beyond 
content  of 
satellite 

courses  290  2-25        13.69       4.21  25  .79 

(2.74)  (.84) 

Satellite 
courses  not 

too  difficult  290  9-42        24.83       5.82  45  .75 

(2.76)  (.65) 

Support  for 
use  of 
satellite 

instruction  290  8-34        21.47       5.48  35  .72 

(3.07)  (.78) 

1  Cj  ^ 

*  Higher  scores  ■  more  positive  attitude.  - 

All  statements  were  answered  using  a  5-point  Likert  Scale. 
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Number  of  Students  in  One  Class 


One  hundred  five  (105)  superintendents  felt  that  one  satellite  teacher  should 
have  less  than  thirty  students.    Thirty-two  felt  a  satellite  teacher  could 
handle  up  to  forty  studer.ts.    Twenty-six  thought  fifty  should  be  the 
enrollment  cap,  and  only  fourteen  would  want  one  satellite  teacher  to  have  as 
many  as  sixty  students. 

Grading 

Superintendents  were  asked  how  they  would  want  their  students  to  be  graded  in 
a  satellite  course.    Hieir  responses  were: 

117  wanted  an  end  of  course  grade  only  (A-F) 
2  wanted  an  end  of  course  percentile  rank  in  class 
6  wanted  an  anecdotal  report 

13  wanted  grade  and  rank  in  class 

18  wanted  grade  and  anecdotal  report 

63  wanted  grade,  rank,  and  report 


Other  Satellite  Offerings 

One  hundred  sixty-seven  (167)  superintendents  reported  that  they  would  like  to 
see  non-credit,  enrichment  courses  offered  by  satellites.    They  were  also  very 
positive  about  using  satellite  technology  to  deliver  graduate  level  courses 
for  their  teachers  (1^3.89,  SD=.99;  scale  ranged  from  Indefinitely  no,  do  not 
offer;  5=definltely  yes,  offer). 


Funding 

One  hundred  fifty-eight  (158)  of  the  superintendents  felt  that  satellite 
courses,  if  offered,  should  be  partially  or  totally  funded  by  a  state  agency. 
Forty-one  indicated  that  these  courses  should  be  funded  by  local  districts. 

Superintendents  were  asked  how  much  their  districts  would  pay  to  enroll  one 
student  for  one  semester:  ^ 

108  would  pay  less  than  $200/student 
89  would  pay  $200-A00/student 
9  would  pay  $400-600/ student 
2  would  pay  $600-800/student 
2  would  pay  $800-1000/student 
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Study  #1:  ooodusior^ 


A  significantly  large  number  of  Iowa  school  superintendents  were  positive 
about  the  use  of  satellite  technology  to  deliver  courses  for  credit.  While 
the  superintendents  ^o  responded  to  this  survey  were  fa    '**om  unanimous  in 
this  positive  attitude,  it  did  not  jeem  that  any  clearly  identifiable  subset 
of  administrators  wanted  satellites  to  be  used  more  or  less  than  any  other 
category.    Positive  (and  to  a  less  extent,  negative)  opinions  seemed  to 
proportionally  distrilfeted  among  the  superintendents  without  correlation  to 
school  size,  coinminity  size,  or  conimmity  location.    While  superintendents  in 
general  reported  that  they  knew  relatively  little  about  satellite  technology, 
there  was  a  significant  relationship  between  level  of  understanding  and 
positive  atcitudes.    While  it  was  likely  that  those  superintendents  who  knew 
the  most  were  ones  who  either  had  already  subscribed  to,  or  were  seriously 
considering  subscribing  to,  the  II-IN  network,  it  also  seemed  that  these 
superintendents  had  these  positive  opinions  because  they  felt  satellites  were 
a  good  idea  and  not  as  a  way  to  rationalize  their  decisions. 

According  to  the  superintendents,  characteristics  of  a  satellite  system  should 
probably  be  as  follows: 


The  purpose  of  this  study  was  to  describe  the  attitudes  of  high  school 
students  toward  interactive  satellite  instruction;  to  identify,  through 
student  opinion,  the  unique  qualities  of  interactive  satellite  instruction; 
and  to  suggest  recommendations  for  improvement. 

A   wo-part  questionnaire,  called  the  Study  of  Satellite  Instruction  (SSI)  was 
designed  to  provide  answers  to  the  study's  research  questions.    The  purpose  of 
Part  One  of  the  SSI  was  to  obtain  background  information  in  order  to  establish 
a  profile  of  characteristics  of  high  school  students  enrolled  in  TI-IN  courses 
and  describe  why  students  had  enrolled  in  TI-IN  course.    The  purpose  of  Part 
Two  of  the  SSI  was  to  describe  the  attitudes  of  high  school  students  toward 
interactive  satellite  instruction  and  provide  an  opportunity  for  them  to 
sxjggest  reconmendations  for  improvement  of  satellite  courses. 

A  list  of  the  names  of  TI-IN  subscribers  in  six  states  was  compiled  from 
viewing  TI-IN  classes.    Twenty- four  school  districts  were  randomly  selected 
from  this  list  and  administrators  were  contacted  by  phone.  Twenty-three 
school  districts  returned  their  student's  surveys.    The  school  district  return 
rate  was  96%.  The  return  rate  of  students  was  73%. 


offer  foreign  language,  science  and  math 

offer  sanester-long  (18  week)  courses  lasting 

forty-five  minutes  per  day,  probably  dvuring 

school  hours  in  the  afternoon 

cost  less  than  $400  per  stiadent 

grade  students  with  traditional  letter  grades  (A-F) 

supported  by  anecdotal  reports 

offer  some  enrichment  programming 

offer  after-school  graduate-level  professional  courses 
for  teachers 
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Part  Gne  of  the  SSI  identified  bac?:ground  information  about  che  TI-IN  students 
and  their  schools. 

The  students  surveyed  were  characterized  as  follows: 

•  57%  were  female  and  A3%  were  male. 

•  31%  were  seniors,  28%  were  juniors,  27%  were  soiAiomores, 
12%  were  freshmen,  and  2%  were  8th  graders. 

t    39%  of  the  students  considered  themselves  to  be  A 
students  and  A9%  considered  themselves  B  students 

•  7A%  of  the  students  thought  they  would  receive  a  B 
or  better  in  the  TI-IN  course  they  were  taking. 

•  95%  were  taking  their  first  TI-IN  coarse. 

•  83%  were  enrolled  in  a  foreign  language  course . 

Additionally,  students  reported  that: 

•  their  high  school  was  small  (x=lA9  students). 

•  their  TI-IN  class  had  8  students  enrolled,  locally. 
(Range=l-21). 

•  they  estimated  their  TI-IN  class  enrolled  over  100 
students,  nationally. 

Part  Two  of  the  questionnaire  consisted  of  AO  statements  that  were  answered 
using  a  Likert-like  agreement  scale.    Each  of  the  statements  was  placed  into 
one  of  five  individual  subtests  measuring  a  different  attitude  construct. 
Each  attitude  subtest  related  to  a   research  question.    A  reliability 
coefficient  of  above  .70  was  reported  for  all  subtests  (See  Table  1). 

The  results  of  responses  from  290  students  showed  that  on  the  whole  students 
had  positive  attitudes  toward  satellite  instruction.    The  students  held 
positive  attitudes  toward  satellite  instruction  (x  =  2.88)  and  felt  TI-IN 
teachers  were  a  major  strength.    Specifically,  students  were  positive  {x  = 
3.22)  in  their  attitude  toward  the  level  of  interaction  between  student  and 
instructor,  yet  mixed  responses  indicated  that  students  would  have  liked  more 
opportunities  for  conmunication.    The  restilts  showed  that  students  had  only  a 
slightly  positive  attitude  (x  =  2.7A)  toward  the  benefits  of  satellite 
instruction  beyond  course  content.    Students  did  not  perceive  the 
establishment  of  relationships  with  other  students  and  the  development  of 
independent  learning  as  major  benefits  of  TI-IN.    The  data  showed  that 
students  did  not  feel  satellite  courses  were  overly  difficult  Cx  =  2.76). 
Students  favorably  supported  the  'ise  of  satellite  instruction  (ir=  3.07),  even 
though  they  tended  to  prefer  traditional  courses  over  satellite  courses. 

The  relationships  and  differences  between  variables  were  analyzed  next  (see 
Table  2).    The  nximber  of  students  in  the  local  class  correlated  positively 
with  all  attitude  subtest  scores,  indicating  that  students  tended  to  want  the 
traditional  "live"  contact  with  other  students,  even  though  they  had  many  TV 
classmates.    The  data  indicated  that  students  \A\o  took  classes  in  the  morning 
had  a  more  positive  attitude  toward  interactive  satellite  instruction  than 
students  v^o  were  taking  classes  in  the  afternoon. 
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Table  2.    Correlation  matrix:    Degree  of  Relationship  Between  Characteristics  of  Students  and  Score  of 
Subtests  of  Attitude  Toward  Satellite  Instruction. 


A 

B 

C 

D 

E 

F 

G 

H 

I 

A. 

Ability  of  student  1.00 

.50* 

.04 

-.06 

.13 

.04 

.11 

.12 

.15* 

B. 

Grade  expected 

1.00 

.15 

.04 

.29* 

.07 

.26* 

.37* 

.35* 

C. 

Local  number  in  class 

1.00 

.14 

.36* 

.22* 

.46* 

.14* 

.44* 

D. 

Total  number  in  class 

1.00 

.04 

-.06 

.10 

.09 

.05 

E. 

Strengths  of  satellite 
instruction 

1.00 

.55* 

.66* 

.47* 

.76* 

F. 

Adequacy  of  interaction 
level 

1.00 

.30* 

.25* 

.41* 

G. 

Benefits  beyond 
satellite  course  content 

1.00 

.38* 

.74* 

H. 

Satellite  courses  not 
too  difficult 

1.00 

.53* 

I.    Support  for  use  of 

Satellite  instruction  1.00 
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The  most  frequent  response  given  by  the  students  about  what  influenced  them  to 
take  a  satellite  course  was  "interest  in  the  subject",  yet  the  students  who 
gave  this  reason  for  enrolling  in  a  satellite  course  generally  ♦:ended  to  have 
a  low  positive  attitude  toward  interactive  satellite  instruction.  Other 
factors  besides  their  interest  in  the  subject  may  have  strongly  affected  their 
attittkle  once  the  course  was  in  progress.    Students  who  named  the  principal  or 
superintendent  as  the  major  influence  for  why  they  took  a  satellite  course 
showed  a  more  positive  attitude  than  the  students  who  named  other  influences. 
Support  by  the  administration  seemed  to  be  a  major  factor  in  the  success  of  an 
interactive  satellite  program. 

A  list  of  what  students  liked  best  and  least  about  their  satellite  couvse  and 
a  list  of  suggestions  for  Improvement  of  interactive  satellite  instruction  was 
complied  from  three  open-ended  questions  (Tables  //3,  #A,  and  #5).  Although 
generally  students  had  positive  attitudes  toward  instruction  via  satexlite, 
the  development  of  more  interesting  methods  to  present  course  material  and  the 
reduction  of  total  class  size  in  order  to  provide  more  scudent-teacher 
interaction  and  remedy  the  congested  phone  system  were  recommendations  made  to 
improve  interactive  satellite  instruction. 


The  responses  from  the  questionnaire,  Opinions  of  Teacher  Leaders  and  School 
Administrators  Toward  Satellite  Delivery  of  Instruction  (OTLSA),  were  used  to 
.describe  the  attitudes  of  these  individuals  toward  satellite  delivery  of 
courses  for  high  school  credit.    The  data  were  collected  from  the  OliSA  and 
statistically  analyzed. 

This  section  of  this  paper  contains  the  resalts  of  the  statistical  procedures 
used  to:  (1)  provide  a  descriptive  profile  of  the  participating  respondents, 
(2)  present  a  brief  description  of  the  respondent's  school  district,  (3) 
provide  a  sunmary  of  the  attitudes  of  respondents  toward  interactive  satellite 
instruction,  (4)  provide  an  examination  of  relevant  relationships  among 
variables  used  in  the  study,  and  ^5)  present  a  sunmary  of  potentiid  problems 
foreseen  and  additional  comments  about  the  use  of  satellite  courses. 

The  rate  of  return  for  the  OTLSA  was  good.  The  return  rate  of  the  teacher 
leaders*  and  school  administrators'  questionnaires  was  calculated  using  100  as 
the  number  of  individuals  sampled  and  80  as  the  number  of  returned 
questionnaires,  so  the  overall  return  rate  was  eighty  percent.  Teacher 
leaders  returned  36  surveys  for  a  return  rate  of  seventy-two  percent,  and  the 
school  administrators  returned  AA  surveys  for  a  return  rate  of  eighty-eight 
percent. 


The  purpose  of  Part  One  of  the  OTLSA  was  to  proved  a  descriptive  profile  of 
the  sample.    Frequency  distributions  were  computed  for  each  item  in  Pari  One 
of  the  OTLSA  in  order  to  describe  characteristics  of  the  sample. 

The  characteristics  of  the  sample  are  described  and  reported  in  the  same  order 
that  the  question  relating  to  that  characteristic  appeared  in  Part  Oie  of  the 
OTLSA: 
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Table  3.    What  Students  Liked  Best  About  Their  Satellite  Course 


Number  of 

Response  responses 

Subject  was  interesting  64 

Good  teacher;  good  personality  37 

Easier  than  traditional  34 

Meet  and  talk  to  other  students  33 

Nothing  28 

Different;  change  in  routine  22 

Relaxed,  fun  20 

Teacher  not  present  17 
Opportunity  to  take  course  not  offered; 

needed  for  college  17 

Interesting  specials  12 

Challenging;  learning  more  11 

Fosters  independent  learning  11 

Chance  to  call  in  9 

Everything   5 

Total  320 
 :  4«  

O 
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Table  4,    What  Students  Liked  Least  About  Their  Satellite  Course 


Number  of 

Response  responses 

Boring;  uninteresting  S3 

Hard  to  unaerstand  35 

Too  much  homework  end  labs  35 

Calling  is  difficult  27 

Instructor  unorganized  and  hard  to  understand  26 

Lack  of  communication  21 

Scheduled  at  a  poor  time  of  day  20 

Tests  too  difficult  14 

Unable  to  ask  questions;  feel  uncomfortable  11 
Everything  10 
Hard  to  make  up  work  from  vacations  or  abiences  9 
OK  the  way  it  is  9 
Poor  TV  reception  8 
Not  challenging  6 
Impersonal  and  not  enough  interaction  with 

other  students  5 
Poor  phone  coxmections  A 

Subject  matter   3 

Total  296 
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Table  5.    Student  Suggestions  for  Improvement  of  Satellite  Courses 


Number  of 


Response  responses 

Hore  variety  33 

More  student-teacher  interaction  30 

More  organization  25 

Improve  phor.e  system  18 

Reduce  class  size  17 

More  involvement  with  other  students  14 

Schedule  at  a  different  time  14 

Better  TV  reception  I3 

More  courses  and  different  course  levels  12 

Eliminate  satellite  courses  12 

Improve  tests  and  grading  methods  8 

Facilitators  receive  more  training  7 

More  handouts  and  study  guides  5 

Total  208 
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(1)  Overall,  sixty-four  percent  (63.75%)  of  the  respondents  were  male, 
and  approximately  thirty-six  percent  (36.25%)  of  the  respondents 
were  female.  Teacher  leaders  were  sixty-one  percent  (61.11%)  female 
and  thirty-nine  percent  (38.89%)  male.  School  administrators  who 
returned  to  OTLSA  were  eighty-four  percent  (84.09%)  male  and 
sixteen  percent  (15.91%)  female. 

(2)  Overall,  the  average  age  of  the  respondents  was  found  to  be  47.31 
years,    teacher  leaders*  average  age  was  43.53  years.    Females  and 
iuales  averaged  44.05  and  452.71  years  of  age,  respectively.  School 
administrators*  averaged  50.41  years  of  age.    Female  administrators 
averaged  44.57  years,  and  males  a^^eraged  51.51  years  of  age. 

(3)  All  of  the  respondents  were  asked  to  indicate  the  highest  acadonic 
degree  they  had  successfully  completed,  or  credits  they  had  toward 
the  next  highest  degree.    All  had  credits  beyond  an  undergraduate 
college  degree,  -/^proximately  twenty--six  percent  (26.25%)  had 
received  a  Doctorate  and  thirty-three  percent  (32.50%)  had  credits 
towards  a  Doctorate.    Thirty-four  percent  (33.75%)  of  all  the 
respondents  had  received  a  master's  degree  and  eight  percent 
(7.50%)  had  credits  toward  a  master's  degree.    Approximately  six 
percent  (5.56%)  of  teacher  leaders  had  a  Doctorate  and  twenty-two 
percent  (22.22%)  had  credits  towards  a  Doctorate.  Fifty-six 
percent  (55.56%)  of  teacher  leaders  had  received  a  master's  degree 
and  seventeen  percent  (16.67%)  had  credits  toward  a  master's 
degree.    Forty-three  percent  (43.18%)  had  received  a  Doctorate, 
forty-one  percent  (40.91%)  had  credits  toward  a  Doctorate,  and 
sixteen  percent  (15.91%)  had  a  master's  degree. 

(4)  Overall  the  average  number  of  years  employed  in  education  for  the 
entire  group  of  those  responding  (combination  of  years  as  teacher 
and/or  administrator)  was  23.50  years.  Teacher  leaders  averaged 
20.03  years  in  education.  Females  averaged  19.05  years  and  males 
averaged  21.57  years  of  experience.  School  administrator  leaders 
averaged  20.43  and  27.46  years,  respectively. 
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Dfeacripticn  of  Beqxndeato*  Sdml  Districts 


Each  respondent  was  asked  to  answer  questions  conpeming  the  school  district 
where  they  were  oorrently  or  most  recently  employed.    The  school  districts 
were  located  across  the  United  States.    Questions  about  the  school  district's 
enrollment  size,  recent  fluctuations  in  enrollment,  and  use  of  satellite 
reception  systems  were  asked,  also. 

(1)   As  expected,  the  size  of  the  school  districts  varied.  The 
percentages  of  each  category  were: 


Less  than  1,000  -  9% 

1,000-5,000        -  38% 

5,000-15,000      -  38% 

15,000-25,000     -  9% 

2S, 000-45, 000     -  6% 

over  45,000        -  6% 

(2)   Forty  percent  of  the  respondents  indicated  that  their  school 

district  had  recently  increased  in  enrollment.    Thirty-six  (36.25%) 
said  that  their  school  district  had  stayed  about  the  same  size,  and 
twenty-four  percent  (23.75%)  said  their  districts  had  decreased  in 
enrolljTyent . 


(3)   The  majority  (83.75%)  of  the  respondents  indicated  that  their 

school  district  was  doing  little  with  satellite  delivery  systems. 
Nine  percent  (8.75%)  were  considering  implementing  e  satellite 
reception  system  for  couises,  and  eight  percent  (7.50%)  were 
currently  using  a  satellite  reception  system  for  courses. 

Attitudes  of  Headier  Loaders  and  Scbool  A^lnistrators 

The  primary  purpose  of  this  study  was  to  describe  the  attitudes  of  teacher 
leaders  and  school  administrators  toward  delivery  of  interactive  satellite 
instruction.    The  teacher  leaders  and  school  administrators  were  asked  to 
choose  the  response  that  best  described  how  they  felt  about  each  of  the  30 
statements  in  P&rt  II  of  the  OTSA.    Hie  respondents  used  the  following 
Llkert-like  scale: 

SA  =  Strongly  Agree 

A  =  Agree 

U  =  ttidecided 

D  =  Disagree 
SD  =  Strongly  Disagree 
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In  order  to  answer  the  research  questions,  each  of  the  30  statements  in  Part 
II  of  the  OTLSA  was  placed  into  one  of  four  attitude  categories  or  subtests. 
Each  subtest  was  relevant  to  one  of  the  research  questions.    Each  subtest  was 
considered  an  individual  measure  of  an  attitude  construct  and  was  examined 
separately. 

The  reliability  of  each  subtest  was  computed.    A  reliability  coefficient  of 
above  .70  was  reported  for  all  but  one  subtest. 

An  indication  of  favorable  positive  attitude,  or  an  unfavorable  negative 
attitude  was  determined  by  the  following  statistical  procedures: 

(1)  The  mean  for  each  subtest  was  computed.    A  score  at  or  above  the 
midpoint  of  total  possible  points  was  considered  a  favorable 
attitude.    A  score  below  this  midpoint  was  considered  an 
lanfavorable  attitude. 

(2)  The  average  score  (mean)  was  found  for  each  item  to  allow  the 
researcher  to  e3camine  each  subtest  item  separately.    A  score  of 
2.50  or  above  was  considered  to  indicate  a  favorable  attitude  for 
each  item.    A  score  of  less  than  2.50  was  considered  a  negative 
attitude  (Table  7). 

Satellite  instruction  is  considered  appropriate 

Subtest:   What  is  the  appropriateness  of  using  satellites  to  deliver  courses 
for  credit  to  high  school  students  (i^propriateness  of  Satellite  Instruction)? 

Table  7  itidicates  that  teacher  leaders  and  school  administrators  hold  a 
generally  neutral  but  positive  attitude  (3c=2A.35)  toward  the  appropriateness 
of  satellite  instruction.    The  subtest,  Appropriateness  of  Satellite 
Instruction,  had  a  possible  total  score  of  40.    A  score  of  21  or  above 
indicated  a  positive  attitude.    An  analysis  of  the  subtest's  items  showed  that 
teacher  leaders  and  school  administrators  generally  did  not  consider  satellite 
delivery  of  instruction  the  same  as  TV  courses  (3^3.69),  and  that  satellite 
courses  probably  would  motivate  and  hold  the  interest  of  students  ("51=3.16). 

Satellite  instruction  has  positive  effects  on  the  teaching  profession 

Subtest:    What  is  the  effect  on  the  teaching  profession  if  satellite  course 
delivery  becomes  widespread  (Effect  on  Teaching  Profession)? 

The  average  of  the  subtest,  Effect  on  Teaching  Profession  (x=25.25),  indicated 
that  teacher  leaders  and  school  administrators  generally  held  a  positive 
attitude  toward  the  effect  that  satellite  instruction  had,  or  would  have,  on 
the  teaching  profession.  The  highest  possible  score  was  35.    A  positive  score 
was  18  or  above.    An  analysis  of  the  subtests'  items  indicated  that  teacher 
leaders  ana  school  administrators  believed  that  teachers'  job  opportunities 
would  probably  not  be  reduced  because  of  satellite  delivery  of  instruction 
(x=3.68). 
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Table  6.    Study  3  -  Description  of  Those  Responding 

Gender 

Teacher  Leaders 

Administrative  Leaders 

Totals 

Female 

61% 

16% 

36% 

(22) 

(7) 

(29) 

Male 

39X 

84% 

64% 

(15) 

(37) 

(51) 

Approximate 

Age 

Teacher  Leaders 

Adminstrative  Leaders 

Averages 

43 

50 

47 

Formal  { 

Education 

T'  acher  Leaders 

Administrative  Laaders 

Doctorate 

6X 

4n 

Masters  + 

12% 

Masters 

56% 

167. 

Bachelor  + 

16% 

Years  of 

Experience 

Teacher  Leader'' 

Administrative  Leaders 

Average 

20 

23.5 

School 

Less  than  1000- 

5000-         1 5000- 

25000- 

more  than 

Size 

1000  5000 

15000  25000 

45000 

45000 

9%  35% 

35%  9% 

6% 

6% 

Table  7.    Attitudes  toward  satellite  instruction:  subtes 


Subtest 

Number 
Responding 

Range 

of  Scores 

Mean 
Score* 

SD 

Highest 

Pn  4  4 1  T>  1  p 

Score 

Pol  t  iiKi  1  1  f*  17 

of  Subtest 

Appropriateness 
of  Satellite 
Instruction 

80 

13-31 

24.35 
(3.04) 

3.92 
(.49) 

40 

.75 

Effect  on  the 

Teaching 

Profession 

80 

15-33 

25  25 
(3.61) 

(.53) 

•  7Z 

Effect  on  the 

School 

Curriculum 

80 

15-32 

22.95 
(3.28) 

3.46 
(.49) 

35 

.72 

Perceptions  of 
Needed  Controls 

80 

16-35 

24.95 
(3.12) 

3.59 
(.45) 

40 

.64 

*Higher  scores  =  more  positive  attitude. 
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Satellite  instruction  has  a  positive  effect  on  the  school  ciirriculum 


Subtest:    What  will  be  the  effect  on  the  school  curriculum  in  order  to 
acconinodate  satellite  courses  (Effect  on  the  School  Curriculum)? 

Table  8  shows  the  subtest,  Effect  on  the  School  Curriculum,  had  a  possible 
total  score  of  35.   A  favorable  attitude  score  was  18  or  above.    The  average 
score  was  found  to  be  22.95  and  indicated  that  teacher  leaders  and  school 
administrators  had  a  generally  positive  opinion  toward  the  effect  that 
satellite  instruction  would  have  on  the  school  curriculum. 

Satellite  instruction  has  the  needed  controls 

Subtest:    What  are  the  teacher  leaders'  and  school  administrators'  perceptions 
of  the  controls  that  will  be  needed  when  satellite  courses  are  planned  and 
delivered  in  order  to  maintain  quality  of  content  (Perceptions  of  Needed 
Controls)? 

The  mean  of  the  subtest,  perceptions  of  needed  controls  (x=24.95),  indicated 
that  teacher  leaders  and  school  administrators  favored  the  controls  currently 
in  place  for  satellite  instruction.    The  subtest  had  a  possible  score  of  40. 
A  positive  score  was  21  or  more.    An  item  analysis  of  the  teacher  leaders'  and 
school  administrators'  subtest  responses  showed  that  *-hey  felt  satellite 
course  instructors  should  be  certified  In  the  receiving  state  (Tp=3.55). 

MrilfioMl  Jnalysls 

Descriptive  statistics  of  all  student  characteristics  and  subtest  scores  were 
examined  to  determine  if  further  analyses  were  appropriate.    The  data  were 
analyzed  using  Pearson  product  moment  correlation  and  t-tests. 

Correlation 

The  Pearson  product  moment  correlation  technique  was  used  to  determine  the 
strength  of  the  relationship  between  the  characteristics  of  teacher  leaders 
and  school  administrators  and  the  subtests.    The  characteristics  examines  were 
(1)  sex  of  respondent,  (2)  the  higfiest  degree  received,  or  credits  towards  one 
(degree),  (3)  the  number  of  years  the  respondents  had  been  anployed  in 
education,  (4)  the  respondents'  school  district's  enrollment  for  K-12,  (5) 
their  district's  enrollment  fluctuations,  and  (6)  their  district's  current 
usage  of  satellite  reception  systems  (current  satellite  usage). 

The  most  interesting  observation  derived  from  the  analysis  of  the  correlations 
was  that  while  there  were  a  number  of  statistically  significant  correlations, 
there  were  few  practically  significant  relationships. 
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Table  8.  Correlation  matrix:  Degree  of  relationship  between  characteristics 
of  Study  #3  sample  and  attitude  siibtest  scores. 


Sex 
of 

Respondent 


Highest 

Degree 

Received 


Years 
Employed 
in  Ediication 


School 
District's 
Ehrollment 


Sex  of  respondent 


.27 


.44 


.43 


Highest  degree 


.33 


-.13 


Years  employed  in 
education 

School  district's 
enrollment 

Ehrollment 
fluctuations 

School  district's 
current  satellite 
usage 

Appropriateness 
of  satellite 
instruction 

Effect  on  the 
teaching  profession 

Effect  on  the  school 
curriculum 

Perceptions  of  needed 
controls 


ERLC 


505 


Table  8.    Correlation  matrix  -  continued. 

Ehrollment 
Fluctuations 

School  District's 
Current  Satellite 
Usage 

i^propriateness 
of  Satellite 
Instruction 

Effect  on  the 
Teaching 
Profession 

Sex  of  respondent  .14 

-.01 

.28 

-.09 

Highest  degree  -.13 

-.10 

.27 

-.19 

Years  employed  in  -.29 
edtication 

-.16 

.44 

-.01 

School  district's  .34 
•  enrollment 

-.02 

-.02 

.24 

Enrollment 
fluctuations 

.03 

-.07 

-.04 

School  district's 
ciirrent  satellite 
usage 

-.22 

.03 

Appropriateness 

of  satellite  instruction 

.12 

Effect  on  the 
teaching  profession 

Effect  on  the  school 
curriculum 

Perceptions  of  needed 
controls 

7 
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Table  8.   Correlations  matrix  -  continued. 


Effect  on 
the  School 
Currlctdum 


Perceptions 
of  Nieeded 
Controls 


Sex  of  respondent 

.20 

.20 

Highest  degree 

.19 

.17 

Years  employed  In 
education 

.14 

-  91 

School  district's 
enrollment 

.30 

48 

Ehrollment 
fluctuations 

-.25 

11 
•  LL 

School  district's 
current  satellite 
usage 

-.15 

-.01 

Appropriateness 

of  satellite  Instruction 

.38 

.63 

Effect  on  the 
teaching  profession 

.35 

.24 

Effect  on  the  school 
curriculum 

.24 

Perceptions  of  needed 
coitrols 
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t-tests 


The  t-test  was  used  to  determine  if  there  was  a  significant  difference  between 
teacher  leader's  and  school  administrator's  subtest  scores.    Table  9  shows 
that  the  average  scores  of  teacher  leaders  and  school  administrators  for  the 
subtest.  Effect  on  the  Teaching  Profession,  were  almost  identical.    All  other 
subtest  scores  were  quite  different.    The  level  of  significance  (p)  for  two 
subtests,  i^propriateness  of  Satellite  Instruction 

(p<.OCX)l)  and  Perceptions  of  Need  Controls  subtest  results  (p^.Ol),  showed 
that  there  was  a  highly  significant  difference  between  the  attitudes  of 
teachers  and  administrators.    In  other  words,  administrator  leaders  tended  to 
have  more  positive  attitudes  than  teacher  leaders  about  the  use  of  satellite 
technology.   Also,  administrators  seemed  to  be  less  in  favor  of  more  controls 
on  the  use  of  satellite  technology  in  the  schools  than  were  teachers. 

The  t-test  was  also  used  to  determine  if  there  was  a  significant  difference 
between  males'  and  females'  subtest  scores.    The  t-test  indicted  that  males 
had  more  favorable  attitude  scores  on  all  but  one  subtest  (Perceptions  of 
Needed  Controls)  than  feinales  (Table  4).    In  other  words,  males  generally 
tended  to  be  more  positive  than  females  about  the  use  of  satellite  technology, 
and  males  tended  to  be  less  in  favor  of  more  controls  than  females. 

suggested  lapcoveacnts 

A  second  purpose  of  this  study  was  to  identify,  by  using  teacher  leaders'  and 
school  administrators'  opinions,  potential  problems  that  might  occur  with  the 
routine  use  of  satellite  courses.    This  information  was  obtained  in  Part  Two 
of  the  OTLSA. 

These  questions  were  stated  in  an  open-ended  format  so  that  respondents  could 
express  their  opinions  and  give  unprompted  responses.    Similar  responses  were 
grouped.  The  responses  were  ranked  from  the  most  frequent  response  to  the 
least  frequent  response. 

The  first  question  asked  the  respondents  to  describe  what  potential  problems 
they  anticipated  if  school  districts  began  to  routinely  use  satellite  courses 
for  credit.    The  most  frequent  responses  in  descending  order  were: 

(1)  Satellite  courses  would  not  provide  for  the  individualization  of 
teaching  or  learning  (n=13). 

(2)  There  would  be  a  problem  in  scheduling  (n-9). 

(3)  Local  curriculum  vs.  a  standardized  curriculum  might  be  a  problem 
(n=9). 

(4)  Teacher  employment  opportunities  would  be  reduced  (n=8). 

(5)  Certification  of  satellite  teacher  and  local  monitor  was  a  concern 
(n=7). 

(6)  The  cost  of  the  initial  installation  would  be  high  (n=5), 

(7)  Satellite  courses  would  not  be  motivating  to  students  (n=5). 
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Table  9.    t-tests  -  Attitudes 

Toward  Satellite 

Instruction: 

Teachers  vs.  Administrators 

Subtest  N 

X 

SD 

t-value  p 

Appropriateness 
of  Satellite 
Instruction: 
Teacher  Leaders  36 

22.14 
(2.77) 

4.21 
(.53) 

-4.39  .01 

School  Administrators  44 

26.16 
(3.27) 

2.52 
(.32) 

Effect  on  the 

Teaching 

Profession: 

Teacher  Leaders  36 
School  Administrators  44 

25.44 
(3.63) 
25.09 
(3.58) 

3.44 
(.49) 
3.98 
(.56) 

.23  .82 

Effect  on  the 

Scnool 

Curricul\im: 

Teacher  Leaders  36 
School  Administrators  44 

21.97 
(3.14) 
23.75 
(3.39) 

3.94 
(.56) 
2.81 
(.40) 

-1.85  ,07 

Perceptions  of 
Needed  Controls: 

Teacher  Leaders  36 
School  Administrators  44 

26.50 
(3.31) 
23.68 
(2.96) 

3.54 
(.44) 
3.12 
(.39) 

2.80  .01* 

^Higher  scores  ■  more  positive 

attitudes. 

ERIC 

500 

Table  10.    Potential  problems. 


Responses  Number  of  Responses 

Lack  of  individualization  13 

Scheduling  9 

Local  curriculum  vs.  standardized  curriculum  9 

Teacher  jobs  reduced  8 

Certification  of  satellite  teacher  and  monitor  7 

Cost  5 

Lack  of  motivation  for  students  5 

Teacher  union  opposition  3 

Quality  of  satellite  instruction  3 

Commitment  for  all  involved  1 


Total  53 
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The  second  question  asked  the  teacher  leaders  and  school  adninistrators  to 
give  additional  coninents  about  the  use  of  satellites  to  deliver  courses  for 
credit  (see  Table  11).    Their  responses,  in  descending  order  of  frequency, 
were: 

(1)  Satellite  instruction  is  a  plus  for  small  and  rural  schools  (n=8). 

(2)  Satellite  delivery  of  courses  offers  many  curriculum  enhancenent 
opportunities  (n=7). 

(3)  Quality  of  the  satellite  course  is  important.  Teacher  leaders  and 
school  administrators  felt  that  the  courses  needed  to  provide 
inroediate  feedback  and  the  satellite  teacher  needed  to  be  very 
knowledgeable  (n=5). 

(4)  The  monitor's  (teacher  in  the  downlink  school)  role  must  be 
clarified  (n=3). 

Conclusions 

It  was  hoped  that  the  results  of  these  three  studies  would  yield  a  somewhat 
comprehensive  picture  of  the  perceptions  of  administrators,  teachers,  and 
students  toward  satellite  technology.    While  it  is  certainly  difficult  to 
arrive  at  conclusions  from  survey  research,  there  are  trends  and  implications 
that  seem  obvious  ^n  the  results  of  each  study  are  evaluated. 

•  Superintendents  were  generally  in  favor  of  the  use  of  satellite 
technology  to  deliver  courses  for  credit,  and  many  had  plans  to 
install  satellite  reception  systems  in  their  school  districts. 

•  Students  i*o  were  currently  enrolled  in  a  course  being  delivered  by 
satellite  technology  were  generally  positive  about  the  experience. 
Students  tended  to  be  more  positive  if  they  had  a  number  of  local 
classmates  taking  their  course  with  them. 

•  Students  suggested  that  more  variety  was  needed  to  make  satellite 
delivered  courses  more  interesting. 

•  Generally,  leaders  of  state  teacher  and  administrator  associations 
were  positive  about  the  use  of  satellite  technology,  although 
administrator  leaders  tended  to  be  more  positive  than  teachers  and 
tended  to  expect  fewer  controls  on  those  using  this  technology. 

Most  notable  was  the  generally  reported  positive  attitude  toward  the  use  of 
this  new  technology  in  a  distance  education  situation.    Certainly,  satellite 
technology  is  not  opening  to  "rave  reviews."   Just  as  certainly,  it  is  a 
technology  with  considerable  potential  that  at  worst  invokes  a  "wait-and-see" 
attitude.    At  best,  satellite  technology  is  being  positively,  if  somewhat 
cautiously,  endorsed. 
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Table  11.    Additional  comments. 


Response 

Number  of  Responses 

Satellite  instruction  is  a  strength  in  small  and  rural  schools 

8 

Satellite  delivery  of  courses  offers  many  enhancement  opportunities 

4 

Enrichment  courses 

2 

Instruction  should  provide  feedback 

2 

Quality  of  satellite  course 

2 

Clarification  of  monitor's  role 

2 

Advanced  level  courses 

1 

Satellite  teacher  needs  to  be  knowledgeable 

1 

Monitor  nppds  to  hp  a  fAprhpr 

1 

Total 

33 

o 
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TITLE:  THE  BEST  rpLOBfi  pni^  frtinTn-yTsriftr  MATFPT?\rr  pop  modf 
ACTHOR:  Dr.  Jay  Start,  Indiana  University  of  Pennsylvania 
RATIONALE: 

The  use  of  Instructional  materials  In  education  has 

hSSJvI?  ^f^A  *       ""^^y  <orce  In  the  educational  process. 
However,  when  designing  materials  there  are  many  variables 

p2?ci":  lnl\n\:liT  °"  auSlS^Ses'ablu  fto 

S!ch  as  ^'"'^         materials.  Variables 

such  as  time,  color,  and  the  Interaction  of  time  and  color 
have  been  shown  by  previous  research  to  play  an  iS»ort?nt 
e?iL  "nn^'.^**^"*"^  P"""-  ^l^iei  sJudTSS  he 

Vni^V  n""  Vfi^^  ^^'^^^y  °*  ^^"^""^  "hlte  slides  and  v?ewer 
angle.  Coatello  (1969>  studied  captions  and  readab?! 1 ty  of 

s    d^r^,?;;*^?'"'  '^'"^^^  subjects  visual  aiu  ty  of 

slides  with  colored  backgrounds  and  white  symbols. 

Whit*  iCSL'?:^*'*^!  i^^^®^  examined  black  backgrounds  and 
White  symbols,  and  Costello  <1969>  sought  to  determinZ  ?h» 

S?a^k':j;SSl:  S^"'*?"''.*^^  fmany'snSS^e^S  ?!9?2?'S?ud^:d 
tLllt  ?he  ei?»??  o^'k!"!!"^*'''?'"""^''         question  arises 
What  h*«Lni  !  "        ''*ckgrounds  and  colored  symbols. 

A^S  wSa?^rnf.  2  "^"^f^  ^^'V*^^  ^^••^  colored  symbols  Ire  used? 
And  what  role  does  time  play  on  visual  acuity?  The  oreasnt 
study  was  undertaken  to  examine  these  qSest'Sns 
,.h*f  The  purpose  of  this  study  was  twofold:  1.  Determine 
v^Jier''2''D:?erS  nl  ?h°"'?*^?  acSltrJor  the 

mi^TSu;  visS:?'Ici??y!'''  '^"^  necessary  for 

questTons".::?^  J!;;nt?ga?ii?"'  '^•^  following  research 

cnn-ti^t^Si;  ^•^"'"^"atlon,  distance  and  reflectance  remain 
constant,  do  various  colors  differentially  facilitate  th- 
recognition  of  Landolt  Ring  placerr.ent?         f^^^^'^^-^te  the 

time  f;ri°?!!  J"  '"^eractlon  exist  between  stimulus  exposure 
time  and  the  degree  to  which  various  colors  facilitat^ 
recognition  of  Landolt  Ring  placement?  «^<^'Jlt*te 


METHOi  lOLOGY 


cateao??»2*  SS?2i??^  of  this  study  can  be  described  in  five 
StiS2?ui  mItJr  °*         population,  instrumentation 

stimulus  materials,  experimental  procedures,  and.  research 
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1,  Sftlfegtlon  Ckf  th»  DQDulatinn 

The  population  for  this  study  consisted  of  50 
undergraduate  students,  all  of  whom  were  be  between  the  ages 
of  18-22.    All  suojects  were  enrolled  In  the  Communication 
program  at  Duquesne  University,  Pittsburgh,  Pennsylvania- 
Participation  in  this  study  was  on  a  volunteer  basis. 
Students  were  urged  to  participate  b*  t  also  assured  that 
their  grade  would  not  suffer  or  Improve  because  of 
non-participation  or  participation. 

All  subjects  were    given  eye  examinations  for  both 
visual  acuity  and  color  deficiency.    Those  Individuals 
falling  the  eye  examinations  for  color  deficiency  and/or 
visual  acuity  were  llllmlnated  from  the  test  population. 

2.  InatrumftntAtlon 

All  testing  took  place  In  two  rooms.    One  room  was  used 
for  testing  visual  acuity  and  color  visual  deficiencies. 
The  other  room  was  used  for  the  pre  entatlon  of  the 
stimulus.  The  available  light  In  this  room  was  between  10 
and  15  Foot  Lumens  at  all  times  di^rlng  testing. 

Stimulus  materials  were  projected  using  a  Kodak 
Ektagraphlc  Model  B-2  Carrousel  slide  projector  w'th  a 
Kodak  f  3.5  projection  Ektanar  2:00m  lens.    The  light  source 
was  a  General  Electric  300  watt  quartzllne  lamp  ELH  120 
voltr  with  a  color  temperature  cf  3,375  degrees  Kelvin. 

Screen  reflectance  was  measured  and  was  the  same  for 
each  stimulus  slide.    This  was  achieved  by  using  neutral 
density  filters. 

The  time  In  which  the  stimulus  slides  appeared  on  the 
screen  was  controlled  by  an  Ilex  Optical  Co.,  Calumet  Caltar 
no.  5  Universal  Synchro  f  6.3  varl.  Ae  speed  lens.  The 
f-stop  during  testing  remained  completely  open  at  f  6.3. 
Both  front  and  rear  lens  elements  were  removed  so  as  not  to 
Interfere  with  stimulus  projection.    Lens  speeds  were 
checked  by  a  certified  camera  technician  using  an 
oscilloscope  In  order  to  ensure  accurate  speeds. 

3.  Stimulufl  Materials  .  ^ 

The  colors  red  (hues  1,  2,  3>,  blue  (hues  1,  2,  3>, 
green  (hues  1,  2,  3>,  and  yellow  (hues  1,  2,  3>  were  chosen 
because  they  represent  the  widest  portion  of  the  visible 
spectrum. 

To  provide  three  different  hues  of  each  color,  gels  were 
sandwiched  or  stacked  one  upon  another  as  follows; 

Roscoe,  Lene  821  -  Red  (1> 

Roscoe,  Lene  821  ♦  Lene  821  «  Red  (2> 

Roscoe,  Lene  821      Lene  82i      Lene  821  «  Red  (3> 

The  above  method  was  also  used  for  Green,  Blue,  end 
Yel low. 
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It  was  found  when  pr^vloua  reeearch  was  examined  that 
there  are  two  basic  tests  used  when  testing  visual  acuity, 
Snellen  Letters  and  Landolt  Rings.  However,  when  testing 
color  vision  Graham  (1965>  reconmends  Landolt  Rings.  When 
Landolt  Rings  are  used,  the  observer  Is  asked  the  location 
of  the  gap.  The  direction  of  the  gap  Is  changed  to  provide 
var labl 1 1 ty . 

To  determine  the  proper  symbol  size  the  following 
formula  was  used: 

tan  a/2  «  s/2d 

where; 

a  "  visual  size 

s  «  size  of  the  object 

d  »  distance  of  subject  from  object  In  the  same  measurement 
terms  as  the  size  of  the  object. 

(Metcalf,  1969,  p.56> 

According    o  Metcalf  (1969>,  after  all  calculations  are 
completed,  the  proper  symbol  gap  size  Is  2  millimeters  at  20 
feet*    Slides  were  made  from  paste-ups  of  the  symbols  used* 
The  color  gels  were  sandwiched  over  the  symbols.    All  slides 
were  made  using  Kodak  35mni  high  contrast  film.  Exposure 
time  and  development  time  was  the  same  for  each  slide  to 
Insure  uniformity.    Slides  were  mounted  In  Kodak  2"  X  2" 
plastic  slide  mounts  along  with  the  the  colored  gels  and 
neutral  density  filters. 

In  order  to  vary  the  time  at  which  each  slide  was 
presented,  a  variable  speed  lens  with  the  front  and  back 
lens  elements  removed,  was  placed  In  front  of  the  projector 
lens.    The  shutter  was  then  opened  and  the  slide  focused  on 
the  screen.    The  opacity  of  the  shutter  leaves  did  not 
pernit  any  light  to  leave  un  11  the  shutter  was  triggered  by 
the  operator. 

4,  Expgrtm^ntAl  Procftdurgfl 

A  population  Identification  sign  up  sheet  was 
distributed  to  students  enrolled  In  Communication  courses  at 
Duquesne  University.    After  which  subjects  were  chosen  and 
contacted  by  the  researcher  and  given  an  appointment  for 
testing.    At  which  time  subjects  were  asked  to  read  and  sign 
a  Human  Subjects  Consent  focm  before  the  test  was  conducted. 

After  completing  a  GrahAm-Pield  VlauAl  Aeultv  Test  (a 
standard  opthomologlcal  test>  and  an  lahlhara  Color  viginn 
Tegt ,  subjects  were  seated  20  feet  at  a  90  degree  angle  from 
the  p<;reen.    The  room  was  darkened,  and  the  following 
Insti      4ons  played  to  the  subjects  via  cassette  tape 
recorder • 

Please  look  at  the  screen  while  I  give 
you  the  Instructions.    You  will  be 
presented  with  208  slides.    They  will 
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either  be  yellow,  blue,  green,  red,  or 
white.    They  will  be  presented  at 
various  speeds;  although  with  some,  you 
will  be  given  as  much  time  as  you  feel 
Is  necessary. 

After  a  slide  Is  presented,  you  will 
indicate  on  your  answer  sheet  what 
direction  the  break  In  the  circle  Is, 
^»  right,  left,  up,  or  down.    If  you  cannot 

t^ll  the  direction  of  the  gap,  put  an  X 
on  your  answer  sheet.    After  you  have 
decided*  tell  the  operator  to  continue. 

Please  3tay  seated  until  you  are  told  by 
the  operator  that  the  test  Is  over. 
Refrain  from  leaning  forward  or 
squint Ing. 

Before  we  begin,  are  there  any 
quest  Ions? 

After  the  Instructions  were  presented,  subjects  were 
given  answer  sheets. 

Subjects  were  presented  with  208  2"  X  2"  slides. 
Each  series  of  slides  varied  In  color  and  symbol  gap 
direction.    The  speeds  In  which  the  slides  were  presented 
were  5  seconds,  10  seconds,  15  seconds,  and  for  as  long  as 
each  subject  felt  It  was  necessary.    The  order  In  which  the 
slides  were  presented  was  determined  using  a  table  of  random 
numbers.    From  which  a  stimulus  presentation  order  sheet  was 
prepared.    It  took  approximately  30  minutes  to  complete  the 
test,  depending  on  the  length  of  time  It  took  the  subjects 
to  respond. 

5.  RMgareh  Deal  cm 

This  study  was  a  4  x  13  repeated-measures 
design.      (4  speeds    x    13  colors) 

The  indgpendgnt  variables  for  this  study  are  color, 
and  exposure  time.    The  dgpgndgnt  variable  was  each 
subject^s  response  to  the  presentation  stimulus. 
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FINDINGS  AND  CONCLUSIONS 

Annlvslg  of  th^  Data  ,       ^  w  «n 

The  results  of  this  study  were  analyzed  by  means  of  an 
Analysis  of  Variance  for  repeated  measures  and  are 
summarized  in  Table  1.  .  ^ 

As  can  be  seen  in  Table  1.  there  were  three  significant 
effects  obtained  from  the  analysis  of  the  data  gathered  in 
this  research,  providing  affirmative  answers  to  the  two  main 

519 

-569 


5 


effects  hypothesis  and  aa  well  to  their  interactions  Color 
<P  -  136.43;  df  -  12/588;  P  <  .001),  limft  <F  »  7.28;  df  - 
3/147;  P  <  .001),  Color  V  Time  <F  ■  6.15}  df  ■  36/1764;  P  < 
.001>. 

TABLE  1.  ANALYSIS  OF  VARIANCE  SUMMARY  TABLE 


Source 

df 

ss 

ma 

f 

Color 

12 

1980.01385 

165.0015 

136.43 

Error 

588 

711 .14000 

1.20942 

Time 

3 

6.95692 

2.31897 

7.28 

««« 

Error 

147 

46.85077 

0.31871 

Color  X  Time 

36 

75.46308 

2.09620 

6.15 

Error 

1764 

60 1 . 22923 

0.34083 

p  <.001 


Main  Rifmr.tm  Statlatlca. 

Table  2  presents  the  rank  order  of  correct  visual 
acuity  test  means,  with  time  collapsed  across  all  colors. 


TABLE  2.  RANK  ORDER  OF  CORRECT  VISUAL  ACUITY  TEST 

MEANS,  WITH  TIME  COLLAPSED  ACROSS  ALL  COLORS. 


Color  Level  Mean 


White 

3.945500 

Yel low 

(2) 

3.795000 

Yel low 

(3) 

3.760000 

Yel low 

<1) 

3.700000 

Blue 

<1) 

3.680000 

Red 

(2) 

3.655000 

Red 

(1> 

3.650000 

Greei. 

(1> 

3.590000 

Red 

<3) 

3.505000 

Blue 

<3) 

3.270000 

Blue 

(2) 

3.250000 

Green 

(2) 

2.630000 

Green 

(3) 

0.490000 

To  better  Illustrate  the  results  indicated  In  Table  2, 
Figure  1  was  constructed. 
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Figure  .1  Rank  Ord«r  of  Corracc  Visual  Acuicy  T*sc  Means,  wich  Tlaa 
Collapsed  Across  all  Colors. 
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(Insert  figure  1) 

As  can  be  seen  by  examining  Table  2  and  Figure  1,  :he 
color  white  was  seen  best  followed  by  yellow  level  2 
(middle),  yellow  level  3  (dark),  yellow  level  1  (light), 
blus  level  1  (light),  red  level  2  (middle),  red  level  1 
(light),  green  level  1  (light),  red  level  3  (dark),  blue 
level  3  (dark),  and  blue  level  2  (middle).    The  colors 
providing  the  poorest  mean  scores  were  green  level  2 
(middle)  and  gre'^n  level  3  (dark).    The  latter  provided  a 
rather  sharp  drop  In  its  visual  acuity  mean  score  of 
0.490000,  a  difference  of  2.14  from  green  level  2.    The  mean 
difference  between  white  and  green  level  3  (dark)  Is  3.4555. 
Table  3  presents  the  rank  order  of  correct  visual  acuity 
test  means,  with  color  collapsed  across  all  times. 

TABLE  3.    RANK  ORDER  OF  CORRECT  VISUAL  ACUITY  TEST  MEANS, 
WITH  COLOR  COLLAPSED  ACROSS  ALL  TIMES. 


Time 

Mean 

15  Seconds 

3.3180 

5  Secc.ds 

3.2900 

Unl Imlted 

3.2700 

10  Seconds 

3.2400 

In  order  to  better  Illustrate  the  results  Indicated  In 
Table  3  a  graphic  respresentat ion  Is  shown  In  Figure  2. 

(Insert  figure  2. ) 

As  can  be  seen  In  Table  3  and  Figure  2  subjects  were 
better  able  to  see  the  stimulus  (Landolt  Rings)  at  the  15 
second  presentation  time  (m  »  3.3180) »  followed  by  the  5 
second  time  (m  «  3.290),  when  subjects  were  given  as  much 
time  as  they  needed  (unlimited)  the  mean  score  was  3.270. 
The  poorest  stimulus  presentation  speed  was  10  second  speed 
(  m  «  3.240) . 

In  order  to  show  where  the  Interactions  of  this  study ^s 
Independent  variables  took  place.  It  was  necessary  to  plot 
each  color  across  time.    These  Interactions  are  shown  In 
figure  3. 

( Insert  figure  3. ) 
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figure  2.   Rank'Ord«r  of  Corrtct  Visual  Acuity  Test  Means,  With  Color 
Collapsad  Across  All  Tiaas. 
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TABLE  4.  HIERARCHIES  OF  VISUAL  ACUITY  TEST  MEANS  BY  TIME 


S  sees. 

10  sees. 

15  mttca. 

un 1 imi ted 

Ye) low  (2) 

White 

White  Yel .  <3> 

White 

White 

Blue  (1) 

Yellow  (2) 

Red  (1) 

Yel low  <3> 

Yellow  (2) 

Red  (2)  Blue  (1) 

Yellow  (1) 

Yellow  (1) 

Red  (1) 

Green  (1) 

Red  (2) 

Green  (1) 

Red  (2) 

Red  (1) 

Blue  <1) 

Blue  (2) 

Yel .  <3>  Grn.  <1> 

Yellow  <i> 

Yellow  <2> 

Blue  (1) 

Yellow  (1) 

Red  (3) 

Yellow  <3> 

Red  (2  and  3) 

Red  (3) 

Blue  (2) 

Red  (3) 

Red  (1) 

Blue  (2) 

Blue  (3) 

Green  (1) 

Blue  (3) 

Blue  (3) 

Green  (2) 

Blue  (3) 

Green  (2) 

Green  (2) 

Green  (3) 

Green  (2) 

Green  (3) 

Green  (3) 

Blue  (2) 
Green  (3) 

From  the  information  presented  in  table  4  and  figure  3 
the  interaction  of  this  study^s  two  independent  variables, 
color  and  time  can  be  seen  and  visual  acuity  tendencies 
identified.    These  interactions  provide  a  hierarchy  on  which 
specific  colors  are  best  at  specific  times. 

After  examining  where  the  interactions  of  this  study^s 
Independent  variables  intersect,  it  can  be  seen  that  there 
are  very  complex  and  intricate  relationships  between  the  two 
independent  variables.    Because  of  this  only  chose 
interactions  which  provided  meaningful  1  differences  are 
discussed. 

As  can  be  seen  in  table  4,  subjects  were  able  to  see 
the  color  white  best  for  three  of  the  four  presentation 
speeds  10  seconds  (H  »  3.900),  15  seconds  (H  «  4.00) »  and 
unlimited  (H  •  4.00).    At  5  seconds  yellow  level  2  (medium, 
H  '4.00)  was  seen  best.    By  far  the  color  providing  the 
poorest  visual  acuity  scores  was  the  color  green  level  3 
(dark)  with  an  overall  visual  acuity  mean  at  0.49000  (5  sees 
»  0.160,  10  sees.  «  0.120,  15  sees.  »  0.660  and  unlimited 
1.020).     It  should  be  apparent  that  as  overall  presentation 
times  increased,  so  did  correct  responses.    However,  there 
was  a  drop  in  correct  responses  at  the  10  second 
presentation  time. 

The  next  poorest  color  in  terms  of  visual  acuity  was 
the  color  green  level  2  (medium),  in  three  of  the  four 
presentation  times  (5  sees.  «  2.480,  10  sees.  «  2.560,  15 
sees.  «  2.960).      Again,  as  time  increased,  so  did  correct 
responses.    The  exception  to  this  was  blue  level  2  (medium; 
at  unlimited  (m  »  2.680),  giving  a  disordinal  interaction 
with  green  level  2. 
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The  next  poorest  color  was  blue  level  3  (dark)  with  an 
overall  mean  of  3.270  <S  sees.  -  3.30,  io  sees.  »  3.260,  15 
?'  i"*^  unlimited  -  3.160).    It  should  be  noted, 
however,  that  when  overall  mean  seores  for  the  various  eolor 
levels  are  examined,  blue  level  3  (dark)  did  better  than 
blue  level  2  (medium).    This  Is  do  t,o  the  dlsordlnll 
interaction  in  blue  level  2  (ir.-Hi.-;i,  m  -  2.680)  at  the 
unlimited  presentation  time. 

1-  J^*'!?  ""^inlnsr  colors,  red  level  l  (light),  red 

level  z  (medium),  red  level  3  (dark),  green  level  1  (lioht). 
blue  level  l  (light),  yellow  level  1  < light ) .  and  yel 1  of 
I  eve    3  (dark),  there  does  not  appear  to  be  any  other 
meaningful  significant  interactions. 

Summary  of  ^lnr^|nfln 

th*t  presented  above  it  can  be  concluded 

that  when  designing  instructional  materials  the  best  color 
venS    f.^f  followed  by  middle  yellow,  dark 

iVrl^Lri    f  JZV"^'  '^^^  '"^<='*="«  ^•<=''  >l9ht  green, 

dark  red,  dark  blue,  middle  blue,  middle  green,  and  dark 

green,    m  addition,  the  longer  the  amount  of  time  a  visual 

inn-?^!^!"!;"  '^•'•'y       ^«  Finally  when 

considering  co  or  and  time  interactions  in  most  instances  it 

fS?n?u*'?;"'"*'^"?,^*'*^  ^^"^  increases  so  does  a  subjects 
It  iii  hi  ^u^^K***'^'^  Percleve  a  message  regardless  of  color. 
It  can  be  further  generalized  that  the  best  colors  to  be 

"^^••^isnlng  projected  visuals  considering  color  and 
ThI  colors  white,  and  middle  yellow. 

SLS^^h  middle 
green,  and  dark  blue. 
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Structure  and  organisation  in  instructional  text 
-  a'cognitive  perspective  on  practice 

Alistair  Stewart 

Dundee  Institute  of  Technology,  Scotland 
Introduction 

It  has  been  argued  that  the  content  and  structure  of  passages  of  text  are  inextricably 
linked  and  that  students  will  learn  from  text  better  if  they  can  follow  the  organisation 
of  the  material  and  later  use  that  organisation  (Brandt.  1978).  It  has  also  been  argued 
that,  since  comprehension  of  text  can  be  a  cognitively  demanding  task,  authors  can 
help  readers  to  comprehend  and  recall  text  information  by  making  sure  that  the  design 
of  their  text  supports  each  of  the  component  comprehension  processes  that  the  readers 
must  perform,  including,  inter  alia,  identifying  the  important  ideas  in  text,  organising 
those  ideas,  and  integrating  them  with  prior  knowledge  (Glynn  &  Britton,  1984).  The 
organisation  of  text  can  be  made  explicit  through  both  verbal  and  typographical  cueing 
systems  (Glynn,  Britton  &  Tillman,  1985)  but  many  of  the  techniques  for  instructional 
text  design  have  been  developed  in  either  an  a-theoretical  framework,  or  a  framework 
whidi  is  not  very  defensible  in  the  light  of  recent  cognitive  research. 

The  purpose  of  this  paper  is  to  consider  ways  in  which  the  organisation  of  text  can  be 
made  explicit  through  verbal  cueing  and  the  ways  in  which  this  organisation  can  be 
related  to  the  cognitive  processes  of  the  reader.  In  doing  so,  the  paper  re-interprets 
current  practice  within  a  cognitive  framework. 


Highlighting  structure  and  organisation  tlirough  verbal  cues 

It  has  been  argued  that  verbal  cueing  can  be  of  either  a  linguistic  nature,  ie  concerned 
with  the  semantic  and  syntactic  structure  of  the  text,  or  of  an  instructional  design 
nature,  ie  concerned  with  verbal  support  such  as  advance  organizers  and  adjunct 
questions  which,  although  an  integral  part  of  the  text,  are  not  really  part  of  the  content 
(Stewart,  1986). 

The  concern  of  this  paper  is  not  with  the  linguisdc  aspects  of  text  such  as  structiire, 
coherence,  and  content,  but  with  those  textual  factors  supplementary  to  the  main 
content  which  play  an  important  part  in  the  comprehension  of  text  and  are,  thus, 
important  elements  in  the  design  of  text. 
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In  a  review  of  instructional  psychology  Resnick  (1985)  acknowledged  that  the  current 
view  of  reading  comprehension  was  too  recent  to  have  yet  generated  many  instructional 
applications,  but  that,  inter  alia,  older  lines  of  work  on  advance  organizers,  questions, 
and  other  adjuncts  to  text  might  eventually  be  reinterpreted  in  light  of  the  contructivist 
view  of  the  reading  process.  For  the  purpose  of  this  paper,  the  term  'adjuncts  to  text* 
will  be  taken  to  include  such  devices  as  the  statement  of  behavioural  objectives,  the 
provision  of  advance  crganizers,  the  inserting  of  questions,  and  the  activation  of  prior 
knowledge. 

Jonassen  (1985)  has  used  Rothkopfs  (1980)  mathemagenic*  process  to  refer  to  this 
group  of  devices,  contrasting  them  with  'generative'  processes  whidi  he  considers  to  be 
m<m  in  line  with  a  cognitive  approach  to  learning.  According  to  Jonassen,  the 
mathemagenic  approach  seeks  to  orient  learners  to  the  text  and  to  show  them  what  is 
relevant  and  important.  Thus,  it  is,  in  essence,  text  control  of  the  learning  process. 
The  generative  an>roach,  on  the  other  hand,  is  held  to  emphasise  not  only  learner 
involvement  but  learner  control  of  the  processes  that  produce  comprehension.  All  of 
the  devices  referred  to  above  have  b^n  considered  by  Jonassen  as  constructive 
mathemagenic  strategies  which  acJress  meaningfulness  by  attempting  to  orient 
learners  to  the  textual  content  or  by  affecting  the  way  they  process  it,  whereas 
constructive  generative  processes  are  intended,  primarily,  to  increase  the 
meaningfulness  of  textual  content. 

GtMntht  Pioctafaig  Mathemagnlc  hoccnfaig 

CoMtructive  •  Constructive 


^t^t  Uistnictlonal  objecUvei 

^phnsini/iummarizing  Branddnf  pio|rainincd  instruction 

^theiizinf  Advanot  orfvnizert 

Gcnciatlnf  question*  Inserted  questions  (pretest) 

Imailni/UIustratint  Tltlet/headin|s/mirkers 

Mappini/networking  Graphic  oifanizers 


Learner  control  Text  control 


This  dichotomy  is  based  on  the  work  of  Wittrock  (1974)  with  respeci  to  a  generative 
model  of  learning  which  suggests  that  reading  comprehension  is  facilitated  when, 
during  encoding,  learners  use  their  memories  of  events  and  experiences  to  construct 
meanings  for  the  text.  The  actively  constructed  individualised  meanings  represent  each 
learner's  comprehension  of  the  text,  a  ^iew  which  is  consistent  with  thiC 
schema-theoretic  view  of  reading  comprehension.  Later  work  on  generative  processes 
(poctorow,  Wittrock  &  Marks.  1978)  indicates  that  generative  processing  involves 
instructions  to  the  reader  to  generate  associations  among  words,  to  generate  pictures 
and  to  generate  meaningful  elaborations,  activities  which  go  beyond  the  constructivist 
schema-theoretic  view  of  reading  comprehension.  In  this  case  of  'generative*  learning, 
the  reader  is  not  only  generating  meaning,  but  generating  overt  performance  which  can 
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contributf  to  learning.  Jonassen's  constructive  mathemagenic  and  constructive 
generative  terms  certainly  distinguish  between  those  actiidties  of  constructing  meaning 
and  the  overt  articulation  of  that  meaning,  but  the  conclusion  that  the  former  is  an 
example  of  *tex:  control*  while  the  latter  is  an  eximiple  of  Meamer  control*  does  not 
seem  to  be  justified.  Both  involve  cognitive  processing  in  which  the  learner  is  in 
control,  but  the  former  could  be  referred  to  as  *text-induced*  cognitive  processing. 

It  is  in  that  context  that  the  role  of  adjunct  aids  is  reconsidered. 

(a)  advance  organizers 

Anderson  (1984)  has  claimed  that  schema  theory  supr  ^rts  the  practice  of  providing 
advance  organizers  or  structured  overviews  along  the  lines  proposed  by  Ausubel  whom 
he  regards  as  one  of  the  pioneer  schema  theorists,  although  he  has  reservations  about 
Ausubers  insistence  tiiat  organizers  must  be  stated  at  a  high  level  of  generality, 
abstractness,  and  inclusiveness. 

There  seems  to  be  little  point  in  debating  the  precise  nature  of  an  advance  organizer. 
The  suggestion  tliat  ''if  it  works,  it  is  an  advance  organizer**  is  worth  considering, 
whether  the  degree  of  abstractness  or  generalisability  necessary  for  a  true  or;:inizer 
has  been  demonstrated.  Perhaps  the  phenomenon  of  success  is  more  important.  Thus, 
if  verbal  material  provided  prior  to  the  main  text  is  able  to  activate  schema  and  prior 
knowledge  in  the  reader,  and  is  able  through  this  and  through  its  own  structure  to  set 
the  frameworic  and  organisation  of  die  following  text,  then  it  is  creating  a  'set  to  leam* 
context  and  is,  in  a  real  sense,  an  advance  organizer. 


Stewart  (1986)  proposed  a  diagrammatic  representation  of  the  system  which  could 
account  for  the  possible  functioning  or  malfunctioning  of  advance  organizers.  In  the 


system,  the  text  is  the  starting  point  since  it  is  the  first  part  of  the  system  to  be  created. 
From  the  text,  the  advance  organizer  is  developed,  then  the  reader  interacts,  first  with 
the  advance  organizer  and  then  with  the  main  body  of  the  text. 

•  The  text 

The  way  in  which  the  text  is  written,  ie  the  way  in  which  the  content  is  treated  with 
respect  to  top-level  structure  etc,  the  way  in  which  main  features  are  highlighted,  and 
the  way  in  which  cohesion  is  achieved,  will  affect  not  only  the  ccr-^prehension  process 
as  the  reader  reacts  with  the  text,  but  will  also  affect  the  possibilities  for  the 
construction  of  the  advance  organizer.  The  text,  therefore,  may  be  well  structured  or 
poorly  structured  with  respect  to  all  three  variables,  or  it  may  be  anywhere  in  between. 

•  The  organizer 

Whether  it  is  prepared  in  accordance  with  Ausubelian  parameters  or  not,  the  de  facto 
advance  organizer  may  extend  from  a  single  word  (as  in  a  title)  to,  perhaps,  a  1000 
•word  nuni-discourse  and,  within  that  continuum,  may  have  a  varying  degree  of 
isomorphism  (ie  the  extent  to  which  it  reflects  the  structure  of  the  text),  and  may  have 
varying  degrees  of  generality  and  abstraction. 

•  The  reader 

The  advance  organizer  will  probably  be  the  first  part  of  the  printed  material  to  be  read 
by  the  reader,  and  the  parameters  affecting  his/her  ability  to  interact  with  and  learn 
from  text  are  really  just  as  important  in  inte.  acting  with  and  learning  from  trie  advance 
organizer  (cf  Dinnel  &  Glover,  1985).  The  reader  may  or  may  not  have  the 
pre-requisite  world  knowledge,  the  declared  purpose  for  reading,  or  the  developed 
strategies  and  metacognitive  skills  necessary  to  benefit  from  the  advance  organizer 
and,  subsequently,  fi-om  the  text. 

The  manv  variables,  often  intemi  ,ly  infinitely  variable,  make  it  virtually  impossible  to 
be  about  when  advance  organizers  will  or  will  not  be  effective.  Nevertheless, 

h>"  -d  to  the  research  evidence  concerning  advance  organizers  in  relation  to 

f/..  wledge  and  schema  theory,  Stewart  (1986)  proposed  the  following  general 
priac.|/ie: 

"If  the  reader  is  oriented  by  a  brief  verijal  organizer  toward  the 
application  of  existing  knowledge  to  the  assimilation  of  the  main 
features  of  new  knowledge  in  text,  then  comprehension  of  that 
new  knowledge  will  be  facilitated'  . 

This  principle,  when  put  into  practice,  requires  an  approach  to  the  design  of  advance 
organizers  which  is  significantiy  different  from  current  practice  in  that  there  is  an  oveit 
emphasis  on  the  acitivation  of  existing  knowledge  which,  witiiin  a  traditional  approach, 
might  have  occurred  only  because  it  happened  to  be  part  of  tiie  way  in  which  advance 
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organizers  operate.  Making  explicit  a  need  to  activate  prior  knowledge  is  really 
guidance  to  the  reader,  as  is  the  linking  of  this  to  the  main  features  of  new  knowledge 
in  the  text.  The  organizer  with  respect  to  the  new  knowledge  is,  however,  more  in  line 
with  the  traditional  approach  to  advance  organizers.  Conceivably,  it  would  be  possible 
to  separate  the  'guidance'  from  the  'organizer',  but  an  integrated  approach  would 
probably  be  better  and  what  is  required  is  really  an  extension  or  broadening  of  the 
concept  of  advance  organizer  to  include  the  element  of  guidance  'mplicit  in  the 
identified  principle. 


(b)  graphic  organizers 

From  the  published  research  relating  to  graphic  organizers  there  are  clearly  two 
problems.  First  what  can  be  classified  as  a  graphic  organizer  and,  second,  the  issue  of 
pre-  or  post-  application. 

The  second  problem  is  more  easily  dealt  with.  Research  which  deals  with  graphic 
post-organizers  also  deals  with  reader-generated  as  opposed  to  author-provided 
organizers  and,  as  has  already  been  noted,  this  sort  of  activity  involves  the  reader  in  a 
generative  activity  which  could  require  a  different  level  of  cognitive  processing  since 
overt  performance  is  required. 

The  first  problem  of  definition  is  more  difficult,  but  likely  to  be  more  useful  if 
resolved.  Based  upon  a  verbal-pictcmal  continuum  as  proposed  by  Wileman  (1980), 
Hawk,  McLeod,  and  Jonassen  (1985)  have  argued  that  graphic  organizers  can  contain 
both  pictorial  (iconic  sign)  and  verbal  (digital  sign)  information  and  that,  in  accordance 
with  Paivio's  (1971)  dual  coding  hypothesis,  graphic  wganizers  in  text  induce  dual 
coding  of  information.  Jonassen  &  Hawk  (1983)  have  identified  the  need  to  ensure  in  a 
graphic  organizer  that  the  location  of  graphic  elements  depicting  the  main  points  and 
the  way  they  are  spatially  related  on  an  organizer  corresponds  to  the  semantic 
relationship  between  the  'main'  ideas,  and,  also,  that  the  graphic  relationships  are 
structurally  isomorphic  to  the  semantic  relationships  in  the  content,  a  point  that  has 
also  been  nuide  by  Schwarz  &  Kulhavy  (1982). 

What  Constitutes  a  graphic  advance  organizer  is  really  any  appropriate  mixture  of 
verbal  and  graphic  material  which  relates  to  the  structure  of  the  text.  At  tiie  intuitive 
level,  there  is  a  case  for  graphic  organizers  being  particularly  effective  when  the 
intention  is  to  relate  to  structure  because  there  is  the  potential  not  only  to  activate 
schema  md  indicate  emphasis  but,  because  of  the  possibility  of  dual  coding  or 
whatever  other  explanation  tiiere  is  for  imagery,  a  higher  level  of  cognitive  operation, 
viz.  relationship  between  ideas,  can  be  presented  as  a  starting  point.  It  is  doubtful 
whether  there  has  yet  been  sufficient  research  carried  out  in  this  area.  Nevertheless, 
from  the  available  evidence  relating  to  advance  organizers  in  general  and  graphical 


organizers  in  particular,  together  with  his  own  investigation,  Stewart  (1986)  derived  the 
following  principle. 

''If  a  '^raphic  organizer  is  used  to  convey  isomorphically  the 
structure  of  ideas  in  text,  then  comprehension  of  the  structure 
will  be  facilitated**. 

Application  of  the  principle  concerning  graphic  organizers  would  require  change  in 
present  practice  for  the  obvious  reason  that  the  use  of  graphic  organizers  is  a  relatively 
rare  occurrence.  The  development  of  a  graphic  organizer  is  a  useful  exercise  when 
analysing  already  written  text  and  can  readily  show  up  weaknesses  and  inconsistencies 
in  the  structure  of  the  text  but  it  is  much  more  appropriate  to  try  to  develop  the 
organizer  based  on  the  ideas  and  their  relationships  prior  to  their  being  put  together  in 
the  text  The  development  of  a  graphic  organizer  is  also  a  very  useful  stage  in  the 
development  of  typographical  cueing  devices  since  it  can  identify  levels  of  headings 
and  sub^headings.  It  really  is  surprising  that  graphic  organizers  are  not  more  commonly 
found  in  instructional  text  considering  that  they  may  well  have  formed  part  of  the 
author's  working  out  of  the  ideas  to  be  included  in  the  text.  It  is  because  a  graphic 
organizer  can  depict  the  struclure  of  ideas  in  text,  in  the  way  that  the  author  intended 
them  to  'ue  related,  that  th^  graphic  organizer  is  wtnthwhile  adopting  in  practice. 


(c)  adjunct  questions 

Research  into  the  wii^^wdveness  of  adjunct  questirn:  ^  >  been  concerned  mainly  with 
the  position  (before  or  after),  type  (factual  or  mer  /J),  and  frequency  of  insertion. 
It  has  been  observed  by  Under  &  Rickards  (198S)  that  all  the  investigations  of 
Rothkopf  (1965)  began  under  the  theoretical  banner  of  neo*beha^iourism  but  that 
recent  subsequent  research  jivolving  adj^jnct  questions  has  assumed  a  cognitive 
perspective  which  emphasises  the  active  and  contru Jtive  role  of  the  learner.  Research 
in  relation  to  adjunct  questions  appears  to  leave  little  doubt  as  to  their  effectiveness 
(Anderson  &  Biddle,  1975;  Duchasiel  &  Whitehead,  1980),  but  P^snick  (1985)  has 
noted  that  there  seems  to  have  been  only  slight  progress  in  the  direction  of  accounting 
for  questioning  effects  in  terms  of  cognitive  processes. 

It  has  been  suggested  by  Hamilton  (1985)  that  subjects  normally  process  the  passage  at 
a  very  superficial  senwitic  level  and  that  verbatim  questions,  whether  pre-  or  post-  are 
answered  on  the  basis  of  this  level  of  processing.  However,  in  the  case  of  semantic 
questions,  the  pre*questions  would  not  only  focus  the  subject  on  the  relevant  prose 
material  but  also  induce  more  than  a  superficial  semantic  level  of  processing  of  the 
target  material,  whereas  post-questions  would  have  minimal  effects  on  the  processing 
of  the  target  material  because  they  occur  after  the  target  material. 
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Under  &  Rickards  (1985)  have  argued  that  higher-level  questions  affect  not  only  the 
level  at  which  niaterial  is  processed  b**t  the  manner  in  which  such  material  is  organised 
in  memory,  and  that  higher-level  questions  therdore  affect  the  quality  as  well  as  the 
quantity  of  recall.  This  is  consistent  with  the  'qualitative  outcomes  of  learning*  research 
to  be  found  among  European  educational  researdiers  (Marton  &  Saljo,  1984;  Entwistle 
&  Ramsden,  1983;  Saljo,  1984).  If  the  reader  can  be  induced  through  the  adjunct 
questions  to  adopt  a  'deep  approach*  to  learning  from  that  particular  reading 
experience,  then  not  only  a  deep  semantic  processing,  but  a  more  meaningful 
processing  is  likely  to  occur. 

Setting  the  work  on  adjunct  questions  in  that  context  led  Stewart  (1986)  to  derive  the 
foi.Jwing  principle. 

''If  higher-level  questions  are  inserted  in  text  they  are  likely  to 
induce  a  deeper  level  of  processing  on  the  part  of  the  reader** 

The  key  features  of  the  principle  relating  to  adjunct  questions,  as  they  affect 
educational  practice,  are  the  emphasis  on  questions  being  'higher-level*  and  the 
outcome  of  their  inclusion  being  a  deeper  level  of  processing.  While  the  practice  of 
including  questions  within  text  is  not  uncommon,  such  questions  are  often  of  a  factual 
recall  nature  and  not  of  the  higher-level  implied  in  the  principle.  No  doubt  there  are 
times  when  factual  questions  are  appropriate  but  where  deeper  levels  of  processing  are 
intended,  higher  level  questions  need  to  be  included. 


(d)  learning  objectives 

Hartley  &  Davis  (1976)  have  noted  that,  despite  a  general  lack  of  agreement  as  to  tlie 
level  of  detail  to  which  behavioural  objectives  should  be  written,  the  majority  of  studies 
have  indicated  that  behavioural  objectives  provide  a  useful  pre-istructional  strategy. 
Hamilton  (1985),  however,  has  observed  that  objectives  have  consistently  produced 
positive  effects  only  for  the  retention  of  ver^itim  information  while  producing 
inconsistent  effects  for  the  retention  of  semantic  verbal  information.  It  appears,  too, 
that  this  effect  is  in  relation  only  to  generally  described  goals  or  objectives  and  that  the 
inclusion  of  other  information  consistent  with  the  Nfagerian  definition  of  objectives 
may,  in  fact,  hinder  the  effects  of  die  objectives. 

To  set  the  above  in  context,  consideration  needs  to  be  given  to  the  nature  of  the 
instructional  objective  or  learning  goal  stated.  In  much  of  the  research  literature,  many 
of  the  objectives  have  been  low-level  recall  of  information.  It  remains  to  be  seen  what 
would  be  the  effect  of  a  high-level  objective.  While  an  advance  organizer  may  activate 
a  particular  schema  or  set  of  schemata,  it  is  unlikely  that  the  statement  of  an  objective 
would  have  the  same  effect.  What  is  much  more  likely  is  that  the  statement  of  a 
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high-level  objective  (ie  high-level  in  the  Bloom  or  Gagne  sense)  would  induce  a 
tet-to-leam  from  which  deep  processing  would  ensue.  On  this  basis,  Stewart  (1985) 
proposed  the  following  principle. 

"If  a  high-level  learning  outcome  is  stated  as  an  Objective  in 
advance  of  reading,  the  learner  is  likely  to  adopt  a  Jeep  approach 
to  reading  of  tiie  passage". 

There  does  not  appear  to  be  any  research  which  examines  the  effectiveness  not  only  of 
high-level  objecti  'es  but  of  high-level  inserted  questions  whidi  measure  achievement  of 
the  high-level  objectives.  There  is  a  strong  relationship  between  tiie  implications  in 
practice  of  tiie  above  principle  and  tiiose  associated  witii  tiie  principle  concerning 
inserted  questions.  In  both  cases  a  deep  approach  is  expected.  In  practice  it  would  be 
appropriate  to  implement  botii  principles  togetiier  by  stating  tiie  high-level  learning 
outcome  in  advance  of  tiie  passage  of  text  and  including  witiiin  tiie  text  high-level 
questions  related  to  tfie  stated  learning  outcome.  Hopefully,  tiie  combined  effect  of 
botti  objective  and  question  would  be  more  certain  tiiaa  eitiier  independenUy  and 
would,  in  fact,  resuh  in  deeper  processing. 


Condtision 

It  is  unfortunate  tiiat  tiie  concept  of  matiiemagenic  activities  ha?  been  so  wide'v 
criticised,  particularly  when  contrasted  witfi  so-called  'generftive*  processes.  It  was 
made  clear  by  Rotiikopf  (1982)  tiiat  tiie  phrase  'matiiemagenic  activities*  was  coined  to 
draw  attention  to  the  importance  of  readers'  activities  in  learning  from  text  because,  at 
tile  time,  practitioners  and  researchers  were  preoccupied  witii  structural  characteristics 
of  text,  ft  has  also  been  made  clear  (Rotiikopf,  1970)  that  tiie  study  of  matiiemagenic 
activities  is  tiie  study  of  tiie  students'  actions  tiiat  are  relevant  to  tiie  achievement  of 
speciiied  instructional  objectives;  tiiat  tiie  concept  of  matiiemagenic  activity  implies 
tfiat  a  learner's  actions  play  an  important  role  in  determining  what  is  being  learned; 
and  tiiat  tiie  most  important  determinant  of  tiie  capabilities  a  student  acquires  from 
printed  material  is  what  tiie  student  does  witii  tiie  insttiictional  materials. 

This  is  not  inconsistent  witii  a  cognitive,  constructivist,  view  of  reading  comprehension, 
nor  does  it  imply  tiiat  control  of  tiie  comprehension  process  lies  in  tiie  text.  Reading 
comprehension  is  an  interactive  process  between  reader  and  text  and  it  is  appropriate 
tiiat  verbal  cueing  (whetiier  it  be  considered  matiiemagenic  or  not)  should  be  used  to 
facilitate  achievement  of  tiie  desired  learning  outcome.  For  tiie  instiiictional  designer, 
tfie  reconsideration  of  adjunct  aids  as  verbal  cueing  devices  witiiin  a  cognitive 
perspective  of  tiie  reading  process  provides  a  defensible  framework  and  challenges  tiie 
designer  to  implement  on  a  basis  of  principle  ratiier  tiian  practice. 
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iDsfrucfional  Plact  and  Situated  Learning; 
The  Challenge  of  Suchman's  Theory  of  Situated  Action 
for  !nstructlonal  Designers  and  Instructional  Systems^ 

by 

Michael  J.  Streibel^ 

Lucy  Such  man  is  a  researcher  at  Xerox  PARC  (Palo  Alto  Research  Center) 
who  studies  how  ordinary  folks  use  Xerox  machines  that  have  built-in  help  and 
diagnosis  programs.  She  distinguishes  between  plan;  (such  as  the  hierarchy  of  sub- 
procedures  for  how  Xerox  machines  should  be  used)  and  situated  actions  (i.e.,  the 
actual  sense  that  specific  users  make  out  of  specific  Xeroxing  events)  and  concl'.des 
that  a  theory  of  situated  action  is  more  true  to  the  lived  experience  of  Xerox  users 
than  a  cognitive  account  of  the  user's  plans  (Suchman,  1987).  Her  distinction  has 
profound  implications  for  the  discipline  of  Cognitive  Science  because  cognitive 
scientists  assume  that  plans  are  the  essence  of  human  ictions.  This  assumption  will 
be  described  throughout  the  paper  as  part  of  the  cognitivist  paradigm. 

Suchman's  distinction  also  poses  a  challenge  for  cognitively  based 
Instructional  Design  because  it  leads  to  the  following  question:  Do  human  beings 
such  as  teachers  and  learners  follow  plans  (no  matter  how  tentative  or  incomplete 
those  plans  might  be)  when  they  solve  real-world  problems  or  do  human  beings 
develop  embodied  skills  that  are  only  prospectively  or  retrospectively  represented 
by  plans,  Suchman  argues  for  the  latter  formulation.  The  question  then  becomes: 


^  This  paper  was  presented  at  the  annual  meeting  of  the  Association  nf 
Egvcational  Communications  and  Technningv   Dallas.  Texas.  Feb.  1-S,  1989. 

'  The  author  of  this  paper  is  an  Associate  Professor  in  the  Educational 
Communications  and  Technology  Program  at  the  University  of  Wisconsin.  528f 

I®?*^l!fn.F*'"*^"*'°"  Building.  225  North  Mills  Street.  Madison.  Wisconsin  53706. 
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Should  instructional  plans  (e.g.,  drill-and-practicc  or  expert  tutoring  instructional 
strategies)  be  designed  into  instructional  systems  in  order  to  control  instructional 
interactions  when  the  users  of  such  systems  learn  in  a  situated-action  manner  and 
not  in  a  plan-based  manner?  Furthermore,  should  any  theory  (i.e.,  instructional  or 
learning  theory)  be  used  to  guide  the  actions  of  teachers  or  learners? 

The  remainder  of  the  paper  will  discuss  Suchman*s  ideas  about  plans  and 
situated  actions  as  well  as  the  implications  of  these  ideas  for  the  design  and  use  of 
instructional  systems.  The  paper  will  end  with  a  brief  discussion  of  John  Seely 
Brown's  extension  of  Suchman's  ideas  and  a  general  set  of  recommendations  for 
instructional  designers  who  want  to  remain  sensitive  to  the  epistemology  of  situated 
learning. 

Plans  and  Inslructlonal  Rvcf#n^| 

Cognitive  science  is  an  emerging  specialty  within  educational  psychology 
that  merges  ideas  from  information  processing  theory  with  disciplinary  knowledge 
from  computer  science  and  artificial  intelligence.  Cognitive  scientists  make  a 
number  of  assumptions  about  the  world  in  order  to  conduct  "normal  science"  in  the 
Kuhnian  sense  of  the  term  (Kuhn,  1970).  For  example,  cognitive  scientists  treat 
mind  as  "neither  substantial  nor  insubstantial,  but  as  an  abstractable  structure 
implementable  in  any  number  of  possible  physical  substrates"  (Suchman,  1987). 
Furthermore,  cognitive  scientists  treat  the  human  mind  as  nothing  but  mental 
operations  that  mediate  environmental  stimuli  and  transform  mental  representations 
into  other  cognitive  structures  called  plans  which,  in  turn,  produce  behavioral 
responses  (Suchman,  1987).  Figure  I  provides  a  brief  summary  of  the  cognitivist 
model  of  mind. 


Insert  Figure  1  about  here 
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The  cognitivist  pr^'adigm  also  permits  cognitive  scientists  to  define  learning 
as  a  change  in  cognitive  structure  and  to  study  various  hwful  ways  in  which 
environmental  stimuli  can  be  manipulated  in  order  to  establish  new  cognitive 
structures  (i.e.,  symbolic  mental  representations)  and  new  cognitive  operations  (i.e., 
cognitive  information  processing).  At  the  heart  of  the  cognitivist  paradigm, 
therefore,  is  the  belief  that  the  mind  is  a  formal  symbol  manipulator  that 
transforms  symbolic  representations  into  plan-based  behavioral  responses. 

Several  things  are  worth  noting  abou^  the  cognitivist  paradigm.  First,  the 
cognitivist  paradigm  gees  beyond  the  behaviorist  paradigm  in  that  it  claims  learning 
to  be  moifi  Ihaa  changes  in  external  behavior.  Learning  is  defined  as  changes  in 
cognitive  structuKS  as  evidenced  by  changes  in  external  behavior.  Gagne  expresses 
this  cognitivist  orientation  when  he  uses  the  concept  of  learned  capabilities  in 
instructional  design  (Gagne,  1987;  Gagne,  Briggs,  &  Wager,  1988).  Second, 
cognitive  structures  or  plans  are  treated  as  the  causes  of  behavioral  responses. 
Environmental  stimuli  still  play  a  role,  but  more  as  information  and  triggering 
stimuli,  than  as  causes  of  behavior.  The  computer  is  the  root  metaphor  for  this 
point  of  view  because  computer  programs  are  the  clearest  expression  of  how  plans 
can  use  input  data  to  control  external  actions  (Pylyshyn,  1984).  Finally,  the 
cognitivist  paradigm  opens  the  door  for  conceptualizing  teaching  and  learning  in 
information  processing  terms  (Streibel,  1986).  Each  of  these  points  will  be 
elaborated  below. 

Instructional  design  theories  such  as  Gagne's  theory  take  the  cognitivist 
paradigm  one  logical  step  further  by  claiming  an  instructional  plan  can  generate  the 
appropriate  environmental  stimuli  and  instructional  interactions  and  thereby  bring 
about  a  change  in  the  cognitive  structures  and  operations  of  the  learner  (Gagne, 
1987;  Gagne,  Briggs,  &  Wager,  1988).  Changes  in  cognitive  structure*  and 
operations  are  inferred  from  the  appearance  of  new  (but  prespecified)  behavioral 
responses.    Reigeluth  articulates  this  next  logical  step  when  he  describes  the 


DrWCriPtiVft  use  <»f  descriptive  instructional  theories  (Reigeluth,  m\  1987).  Figure 
^  shows  a  brief  schematic  of  these  ideas. 


Insert  Figure  2  about  here 

The  cognitivist  paradigm  in  instructional  design  also  has  a  unified 
conception  of  the  teacher  and  the  learner.  When  instructional  strategies  are 
embodied  in  ar  -ructional  system,  instruction  is  viewed  as  an  information  process 
that  is  coupIf'J  with  the  learner's  cognitive  processes  via  environmental  stimuli. 
The  essential  aspect  of  the  teacher,  therefore,  resides  in  the  Knowledge  structures 
and  instructional  plans  that  he.  she.  or  it  (i.e..  instructional  system)  contains.  The 
essential  aspect  of  the  learner  resides  in  the  new  cognitive  knowledge  structures 
and  operations  that  he.  she,  or  it  (i.e..  machine  learning  system)  constructs. 
Instructio..al  plans  in  the  teaC  er  and  cognitive  operations  in  the  learner  here  are 
both  conceptualized  in  information-processing  terms.  Figure  3  spells  out  this 
reconctotualization. 


Insert  Figure  3  about  here 


The  logical  extension  of  ♦he  cognitivist  paradigm  described  above  does  not 
imply  the  instructional  plan  in  the  ir  -tional  system  jausfii  the  changes  in  the 
learner's  behavior.  The  learner  is  not  a  lafeiUa  lasa  as  in  the  behaviorist  paradigm 
(Mackenzie,  1977).  Rather,  the  inleiafiliflU  of  the  learner's  cognitive  operations 
within  the  entire  process  of  the  instructional  system  leads  the  learner  to  SQBSimsi 
new  cognitive  structures  and  operations,  "^he  cognitivist  paradigm  remains 
fundamentally  constructivist  and  individualistic  as  Piaget  has  shown  in  several  of 
his  writings  (Piaget,  1968). 

Finally,  the  cognitivist  paradigm  permits  one  to  posit  that  behavioral 
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responses  and  cognitive  structures  and  operations  can  be  prespecified  because  both 
the  teacher,  the  learner,  and  their  interaction  are  theoretically  described  in  identical 
information-*proce$sing  terms.  Suchinan*s  discussion  about  plans  and  situated 
actions  will  question  the  whole  cognitivist  paradigm  on  this  very  point  Can  the 
cognitivist  paradigm  provide  an  adequate  conceptualization  of  human  teaching  and 
learning  when  these  activities  are  fundamentally  context-bound,  situational  activities 
and  not  context-free,  plan-based  activities?  What  is  the  problematic? 

Thi>  Problematic  of  Plans  and  Instructional  Practice 

The  problematic  in  the  cognitivist  scheme  of  things  resides  in  the 
relationship  between  plans  and  situated  actions  when  luunui  hSlDSl  involved. 
The  pivotal  point  of  the  problematic  centers  on  the  notion  of  interaction. 
According  to  Suchman,  the  traditional  notion  of  interaction  revolves  around  the 
concept  of  ''communication  between  persons"  (Suchman,  1987).  However,  in  the 
cognitivist  paradigm,  interaction  is  restricted  to  the  physical  science  concept  of 
**reciprocaI  action  or  influence."  A  human  learner  who  wants  to  work  within  an 
instructional  system  therefore  has  to  assume  the  ontology  of  a  machine  for 
themselves  in  order  to  "learn"  from  the  machine  (Streibel,  1986).  That  is,  a  learner 
has  to  act  as  an  information  processor  in  order  to  "interact"  with  an  instructional 
:«ystem.  This  result  is  a  direct  consequence  cf  the  cognitivist  view  of  mind  which 
separates  meaning,  imagination,  and  reason  from  a  bodily  basis  (Johnson,  1987). 
This  result,  however,  also  places  the  human  learner  in  a  bind:  Flans  are  generic 
and  work  with  typical  situations  whereas  purposeful  actions  such  as  learning  are 
unique  and  interpreted  in  the  context  of  specific  interactions.  Figure  4  shows  the 
generic  dimensions  of  instructional  systems 


Insert  Fir;ure  4  abou:  here 
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Put  limply,  the  assumptions  of  the  cognitivist  paradigm  conHict  with  the  "life 
world"  of  the  human  learner  because  each  learner  brings  a  unique  biography  and 
history  to  each  new  learning  experience  and  because  each  new  learning  interaction 
entails  a  unique,  context-bound,  sense-making  process.  Whereas  a  cognitive  model 
of  human  learning  is  a  rational  reconstruction  of  minimally  situated  actions,  the 
"life-world*  of  human  learning  is  phenomenologically  and  contextually  bound. 
Whereas  a  cognitive  model  of  tfac  processes  of  human  learning  is  mechanical,  the 
actual  processes  of  human  learning  are  experiential.  And  finally,  whereas  plans 
determine  the  meaning  of  actions  in  the  cognitive  model  of  human  learning,  the 
itt  SilU  interpretations  of  lived  experiences  by  the  participants  determine  the 
meanings  of  actions  in  the  "life-world"  of  situated  actions.  A  generic  instructional 
plan  in  an  instructional  system  can  control  a  cognitive  model  of  human  learning  but 
it  cannot  control  the  "life-world"  of  sJiuated  learning.  Figure  5  summarizes  the 
dimensions  of  the  dilemma. 


Insert  Figure  5  about  here 

The  problematic  described  above  can  be  formulated  as  a  question  Can 
human  beings  reason  and  learn  in  a  situation  where  they  have  to  deny  the 
contextual  nature  of  their  thinking  and  knowing?  Lucy  Suchman  provides  a 
provocative  answer  Ail  real-world  thinJ:'  s  and  knowing  (and  learning)  entails  a 
form  of  context-bound  and  embodied,  situational  action  and  not  plan-based 
interaction.  Let's  look  at  her  arguments  more  closely. 

"AH  activity,  even  the  most  abstract,"  claims  Suchman,  "is  fundamentally 
concrete  and  embodied"  (Suchman,  1987).  Furthermore,  "all  purposeful 
actions...[are]  inevitably  situated  actions...and  primarily  ad  hat"  By  "situated 
actions,"  Suchman  means  simply  "actions  taken  in  the  context  of  particular,  concrete 
circumstances."  This  being  the  case,  "plans  as  such  neither  determine  the  actual 
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course  situated  actions  nor  adequately  reconstruct  it"  (^uchman,  1987). 

I  first  encountered  the  problematic  relationship  between  plans  and  situated 
actions  when,  after  years  of  trying  to  follow  Gagne*s  theory  of  instructional  design, 
I  repeatedly  found  myself,  as  an  instructional  designer,  making  ad  hOi  decision*^ 
throughout  the  design  and  development  process.  At  first,  I  attributed  this 
discrepancy  to  my  own  inexperience  as  an  instructional  designer.  Later,  when  I 
became  more  experienced,  I  attributed  it  to  the  incompleteness  of  instructional 
design  theories.  Theories  were,  after  all,  only  robust  and  mature  at  the  end  of  a 
long  developmental  process,  and,  instructional  design  theories  had  a  very  short 
history.  Lately,  however,  I  have  begun  to  believe  that  the  discrepancy  between 
instructional  design  theories  and  instructional  design  practice  will  never  be  resolved 
because  instructional  design  practice  will  always  be  a  form  of  situated  activity  (i.e., 
depend  on  the  specific,  concrete,  and  unique  circumstances  of  the  project  I  am 
working  on).  Furthermore,  I  now  believe  instructional  design  theories  will  never 
specify  my  design  practice  at  anything  other  than  the  most  general  level. 

My  experience  as  an  instructional  designer  raises  a  deeper  questioa'  Does 
the  problematic  relationship,  which  exists  between  instructional  design  theory  and 
practice,  also  hold  for  instructional  theories  and  practice?  That  is,  is  there  a 
problematic  relationship  between  an  instructional  strategy  or  plan  embedded  in  an 
instructional  system  and  the  resulting  instructional  practice.  Furthermore,  is  there 
a  proble^natic  relationship  between  learning  theories  and  learning  practice?  I  have 
no  doubt  that  instructional  theories  and  learning  theories  are  legitimate  abstractions 
from,  and  rational  reconstructions  of,  instructional  and  learning  actions.  However, 
I  am  beginning  to  question  whether  instructional  theories  or  learning  theories  should 
be  used  to  develop  plans  to  prescribe  instructional  and  learning  actions.  This 
dilemma  is  particularly  poignant  because  I  have  been  professionally  trained  to 
believe  that 

I.     an  instructional  strategy  can  and  should  be  designed  into  an  instructional 
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system, 

2*  an  instructional  strategy  or  pl&n  in  m  instructional  system  is  the  best  (and 
some  would  say  only)  hope  for  guaranteeing  a  change  in  the  cognitive 
strictures  and  operations  of  the  learner  (Heinich,  1988)* 

Lucy  Suchman's  ideas  help  clarify  the  problematic  as  well  as  help  reframe  the 

problem* 

Plans  and  Situated  Agfloiii 

Suchman  first  analyzes  how  plans  are  conceptualized  in  the  cognitivist 
paradigm  and  then  describes  an  alternative  paradigm  for  how  plans  actually  operate 
in  human  beings*  In  the  cognitivist  paradigm,  plans  are  believed  to  be  "prerequisite 
to  and  prescriptive  [of]  action,  at  every  level  of  detail,"  because  the  "organization 
and  significance  of  human  action  [resides]  in  [the]  underlying  plans"  (Suchman, 
1987).  Furthermore,  in  the  cognitivist  paradigm,  mutual  intelligibility  between 
human  beings  reduces  to  (Suchman,  1987): 

A  matter  of  reciprocal  intelligibility  of  our  plans,  enabled  by 
common  conventions  for  the  expressions  of  intent,  and  shared 
knowledge  about  typical  situations  and  appropriate  actions* 

Shared  knowledge  structures,  typical  situations,  and  appropriate  dictiouz  are, 

therefore,  external  and  prior  to  the  same  things  in  other  people*  Furthermore,  two 

people  can  only  understand  each  other  when  they  share  the  same  symbolic 

representations  about  typical  situations  and  appropriate  actions*  Intent  here  is  tied 

to  the  plan  of  action  for  typical,  and  therefore  context-free,  situations*  Figure  6 

sketches  cut  these  ideas* 


Insert  Figure  6  about  here 


The  problematic  in  the  cognitivist  point--of-view  arises  because  the  lived 
experience  of  two  persons  are  not  made  up  of  identical  representations*  Suchman*s 
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argument  here  is  ultimately  based  on  an  appeal  to  experience  because  human  beings 
have  no  privileged  way  of  knowing  whether  an  identity  relationship  exists  between 
the  cognitive  representations  of  different  people.  Our  phenomenological 
experience,  on  ^he  other  hand,  tells  us  that  our  knowledge  always  entails  specific, 
contextual  experience,  and  our  actions  always  proceed  on  the  basis  of  context- 
sensitive,  embodied  skills  and  not  rationally-constructed  plans. 

Suchman  clarifies  the  problematic  between  plans  and  situated  actions  by 
claiming  that  (Suchman,  1987): 

While  the  course  of  action  can  always  be  projected  or  reconstructed 
in  terms  of  prior  intentions  or  typical  siit  Jons,  the  prescriptive 
significance  of  intentions  for  situated  actions  is  inherently 
vague...because  we  can  state  our  intentions  without  having  to 
describe  the  actual  course  of  events. 

Plans,  in  other  words,  say  more  about  our  reasoning  about  action  than  about  the 

actual  course  of  events.  Suchman,  therefore,  claims  that  (Suchman,  1987): 

The  coherence  of  situated  actions  is  tied  in  essential  ways  not  to 
individual  predispositions  or  conventional  rules  but  to  local 
interactions  contingent  on  the  aCiOr*s  particular  circumstances. 

Let  us  use  our  example  of  a  learner  interacting  with  an  instructional  system. 

Extrapolating  from  Suchman*s  arguments,  the  coherence  of  the  learner's  experience 

in  this  situation  is  not  tied  in  essential  ways  to  the  instructional  designer's  intent 

(no  matter  how  detailed  or  explicit  these  intentions  are  spelled-out  as  instructional 

objectives)  nor  to  the  instructional  plan  built  into  the  instructional  system.  Rather, 

the  coherence  of  the  learner's  instructional  experience  is  tied  to  the  sense  that  such 

a  learner  constructs  out  of  the  actual  situation  (of  which  the  instructional  system 

is  just  a  part).  Hence,  the  sense  that  ihia  learner  at  ihia  point  in  time  and  in  this 

situation  will  make  out  of  the  learning  situation  cannot  be  predicted  or  even 

assumed  to  be  understood  by  an  instructional  designer  who  is  not  part  of  the  actual 

situation.    The  best  an  instructional  designer  can  do  is  create  an  instructional 

environment  where  the  learner's  processes  of  situational  sense-making  are  enhanced. 

What  does  this  mean  for  an  instructional  designer?   Suchman  again  provides  a 
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tentative  answer. 

Suchman  considers  face-to-face  human  interaction  to  be  the  "paradigm  case 
for  [all]  communication...tbecause  it  is]  organized  for  maximum  context  sensitivity" 
(Suchman,  1987).  Furthermore,  face-to-face  communication  "brings  that  context- 
sensitivity  to  bear  on  problems  of  skill  acquisition...for  just  those  recipients  on  just 
those  occasions"  (Suchman,  1987).  Face-to-face  human  communication  therefore 
becomes  the  means  through  which  actions  in  a  unique  situation  for  unique  a  learner 
are  connected  to  larger  personal  and  intei  personal  interactions  and  thereby  made 
mutually  intelligible.   In  her  own  research  on  how  novices  learn  to  use  Xerox 
machines,  Suchman  has  users  team  up  and  engage  in  a  conversation  with  each  other 
about  the  concrete  situation.    Meanings  are  constructed  and  negotiated  in  an 
ongoing  dialogue,  and  the  plans  that  the  Xerox  machine  happens  to  contain  are 
only  treated  as  resources.   Furthermore,  sense  making  is  intimately  tied  to  the 
resolution  of  emergent  dilemmas  oy  each  group  of  users.    Suchman  therefore 
concludes  that  the  "conversation"  bstween  the  users  gave  coherence  to  their 
situation  rather  than  the  plans  built  into  the  Xerox  machines.  John  Seely  Brown 
has  taken  Suchman's  ideas  and  generalized  them  to  encompass  everyday  cognition 
(Brown,  1988).  See  Figure  7  for  a  brief  outline  of  these  ideas. 


Insert  Figure  7  abou?  here 


What  roles  siisM  plans  play  in  the  .ontext  of  situated  actions?  For  our 
purposes,  what  role  should  instructional  plans  play  in  the  actual  operation  of 
instructional  systems?  Based  on  our  discussion  so  far,  we  can  begin  to  draw  some 
tentative  conclusions.  First,  we  should  stop  treating  plans  as  mechanisms  that  bring 
about  subsequent  actions: 
1.  in  the  case  of  human  beings,  plans  should  not  be  treated  as  "psychological 
mechanisms"  that  control  and  give  meaning  to  subsequent  behavior.  Rather, 
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plans  should  be  treated  as  ''artifact[s]  of  our  reasoning  about  actions." 
(Suchman,  1987) 

2.     in  the  case  of  instructional  systems,  instructional  plans  should  not  be  used 
to  control  instructional  interactions.  Rather,  plans  should  be  used  for 

a.  communicating  about  situated  actions  with  other  human  beings, 

b.  reflecting  on  and  reccnceptualizing  situational  actions. 

In  short,  instructional  j2lans  shfiuld  l2£  USfid  by  both  instructional  designers  and 
instructional  users  g^  resourcgs  for  future  situated  actions. 

What  do  thes^  tentative  couclusions  imply?  How  can  one  design 
instructional  systems  where  instructional  plans  operate  as  resources  for  the  learners 
and  not  as  controlling  mechanisms?  Suchman^s  situated-action  paradigm  again 
helps  clarify  the  relationship  between  plans  and  situated  learning. 

PImns  and  Situated  Learning 

What  has  Suchman  concluded  so  far?  First,  she  has  claimed  that  "every 
course  of  action  depends  in  essential  ways  upon  its  material  and  social 
circumstances"  (Suchman,  1987).  Second,  she  has  claimed  that  face-to-face 
communication  and  collabo;ative  action  are  essential  for  sense-making  in  any 
situation.  Finally,  she  has  claimed  that  our  knowledge  of  the  physical  and  social 
worlds  is  inter-subjectively  constructed  by  us.  On  the  most  gen  ral  level, 
therefore,  we  can  no  longer  view  instructional  systems  as  mechanisms  that  transmit 
knowledge  or  train  skills  in  an  information-processing  sense  of  the  term.  Plans  can 
play  a  communicative  role  but  not  a  constitutive  role  in  instructional  interactions. 
To  understand  this  more  deeply,  we  have  to  examine  Suchman^s  main  propositions 
about  plans. 

First,  Suchman  admits  that  plans  are  representations  of  situated  act<')ns. 
However,  these  representations  always  come  "before  the  fact  in  the  form  of 
imagined  projections  or  recollected  reconstructions"  rather  than  as  controlling 
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procedures  during  situated  actions  (Suchman,  1987).  Hence,  "plans  orient  us  in 
situated  actions-  rather  than  prescribe  the  sequence  of  actions.  Instructional 
strategies  should,  therefore,  only  be  used  to  orient  future  teachers  or  learners  for 
situated  learning  and  not  prescribe  how  to  teach  or  how  to  learn.   The  actual 
embodied  skills  of  teaching  or  learning  still  have  to  be  worked  out  by  the  teacher 
or  learner.  In  the  case  of  instructional  designers,  instructional  plans  should  only 
be  used  as  general  isssaus^  for  the  design  and  development  of  instructional 
systems.  In  the  case  of  the  operation  of  instructional  systems,  the  instructional 
strategy  should  not  control  the  actual  instructional  interaction.  Finally,  in  the  case 
of  the  human  learner,  the  instructional  strategy  should  be  used  to  orient  the  human 
learner  towards  the  material  rather  than  controlling  and  evaluating  each  behavior. 
The  instructional  system  in  this  scenario  would  act  more  like  a  coach  than  an 
instructor  or  tutor,  and  the  human  learner's  role  would  be  more  that  of  a  self- 
teacher  than  of  a  student.  Figure  8  summarizes  this  point. 


Insert  Figure  8  about  here 


Is  the  foregoing  suggestion  about  instructional  systems  a  romantic  ideal? 
Is  it  unrealistic?  No.  because  the  actual  reality  of  designing  an  instructional  system 
will  always  turn  out  to  be  a  form  of  situational  action.  "Wnen  it  comes  down  to 
the  details."  writes  Suchman.  "you  effectively  abandon  the  plan  and  fall  back  on 
whatever  embodied  skills  are  available  to  you"  (Suchman,  1987).  The  same  can  be 
said  for  instruction  and  learning.  When  an  instructor  or  a  learner  gets  down  to  the 
details  of  teaching  or  learning,  the  respective  theories  of  instruction  or  learning  are 
abandoned  and  the  instructor  or  learner  falls  back  onto  his  or  her  embodied  skills 
in  the  situation.  An  instructional  designer  would,  therefore,  do  well  to  provide  the 
learner,  using  an  instructional  system,  with  the  appropriate  resources  to  develop  the 
learner's  embodied  self-teaching  skills. 
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The  suggestion  that  instructional  systems  should  help  learners  develop 

embodied  learning  strategy  skills  sounds  remarkably  like  the  rhetoric  about  learning 

strategies  design  (0*Neil.  1978;  0*Neil  &  Spielberger,  1979).  However,  one  cannot 

design  plans  to  instruct  learning-strategy  skills  either.  Suchman  clarifies  this  point 

by  saying  (Suchman.  1987): 

It  is  frequently  by  only  acting  in  a  present  situation  that  its 
possibilities  become  clear....In  many  cases,  it  is  only  after  we 
er.counter  some  sute  of  affairs  that  we  find  to  be  desirable  (e.g..  a 
'teachable  moment*  in  a  classroom  for  a  teacher)  that  we  identify 
that  state  as  the  goal  towards  which  our  previous  actions,  in 
retrospect,  were  directed  all  along. 

An  instructional  designer  cannot  therefore  predict  which  aspect  of  th'^  instructional 

plan  or  which  feature  of  the  instructional  system  will  be  interpreted  by  the  learner 

as  a  learning  event,  and  so  cannot  design  a  plan  for  developing  learning  strategies. 

An  instructional  designer  can.  however,  create  a  learning  environment  where 

learning  strategies  are  used  as  resources  by  the  leatner.    In  a  computer-based 

reactive  learning  environment  called  MENDEL  which  I  ani?  my  colleagues  arc 

developi.^g  at  the  University  of  Wisconsin,  a  computer  program  helps  students 

compare  their  intermediate  hypotheses  about  genetics  experiments  against  the  data 

that  the  compuJer  generates  (Streibcl  fit  al..  1987).  The  program  does  not  tutor 

students  about  the  procedures  or  solve  the  problems  for  them,  rather  it  offers 

advice  on  how  to  check  their  ideas.  The  program  does  this  in  spite  of  the  fact  that 

it  contains  an  expert  systems  component  that  could  solve  the  problem  the  student 

faces  in  a  more  efficient  manner.    The  distinction  between  a  plan  as  an 

instructional  algorithm  and  a  plan  as  an  instructional  resource  is  a  very  subtle  one 

but  it  definitely  runs  counter  to  Richard  Clark*s  suggestion  that  the  instructional 

design  component  of  instructional  systems  is  the  most  efficacious  component  as  far 

as  learning  is  concerned  (Clark  &  Salomon.  1986). 

Suchman  also  argues  that  plans  are  only  constructed  by  people  in  actual 
situations  when  (Suchman,  1987): 

Otherwise  transparent  [i.e.  situational]  activity  becomes  in  some  way 
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probleinatized..4That  is],  when  situated  action  becomes  in  some  way 
problematized,  rules  and  procedures  are  explicated  for  purposes  of 
deliberation  [and  communication]  and  the  action,  which  is  otherwise 
neither  rule-bound  nor  procedural,  is  then  made  accountable  to 
them.  ' 

Note  that  representations  here  do  not  stand  in  an  essential  relationship  to  actions. 
Rather,  plans  are  social  and  rational  reconstructions  of  problematized  situated 
actions. 

Teachers  in  the  critical  pedagogy  and  experiential  learning  traditions  have 
long  known  how  to  problematize  learning  situations  and  use  reflection  to  turn 
experience  into  further  action  (Shor,  1980;  Kolb,  1984;  Boud  et  al.,  1985; 
Livingston  fit  al.,  1987).   In  each  of  these  traditions,  teachers  use  face-to-face 
dialogue  in  order  to  problematize  some  part  of  the  world  and  then  use  reflection 
as  a  way  to  get  beyond  the  immediate  situation.  Furthermore,  in  each  of  these 
cases,  teachers  develop  a  dilemma  language  with  the  learners  in  order  to  foster 
mindful  action  (Berlak  St  Berlak,  I98I).  The  key  elements  in  the  critical  pedagogy 
and  experiential  learning  traditions  that  develop  embodied  skills  are,  therefore, 
context-bound  discourse-practices,  negotiation  of  the  very  language  used  to 
characterize  and  resolve  dilemmas,  and  reflective  action.  Both  discourse-practices 
and  reflective  actions  go  beyond  any  rules  and  procedures. 

Instructional  designers  face  a  serious  challenge  from  the  critical  pedagogy 
tradition  because  instructional  designers  are  neither  part  of  the  actual  instructional 
interaction  that  they  create,  nor  are  they  able  to  articulate  a  plan  to  help  students 
problematize,  analyze,  and  reconceptualize  the  "life-world"  of  the  learning  situation. 
At  best,  instructional- designers  can  only  create  simplified  reactive  learning 
environments  where  students  work  collaboratively  to  resolve  artificial  dilemmas. 

Suchman's  third  proposition  about  plans  and  situated  actions  claims  that  "the 
objectivity  of  the  situations  in  oi  actions  is  achieved  rather  than  given"  (Suchman. 
1987).  An  instructional  system  that  operates  according  to  a  plan  made  prior  to 
face-to-face  interaction,  therefore,  undermines  the  very  processes  by  which  the 
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objectivity  of  the  physical  and  social  worlds  is  apprehended  by  new  learners.  In 
the  place  of  interpersonal  construction  i  ality,  such  instructional  systems  offer 
a  coercive  rather  than  a  constructive  interaction.  What  can  an  instructional 
designer  do  about  this?  How  can  an  instructional  system  avoid  coercive 
interactions? 

George  Herbert  Mead  argued,  as  early  as  1934,  that  the  physical  and  social 
worlds  are  ''constructed  by  us  through  language"  (Suchman,  1987).  It  is  therefore, 
through  the  medium  of  language,  that  a  learner  will  construct  and  construe  the 
objectivity  of  some  part  of  the  physical  and  social  worlds.  However,  language  is 
not  a  sec  of  symbols  communicated  through  a  medium.  Language  itself  i$ 
constructed  out  of  socjal  discourse-practices.  It  is  therefore  nol  enough  for  an 
instructional  designer  to  simply  communicate  messages  about  the  physical  end  social 
worlds  to  the  learner  via  the  instructional  system.  Such  a  point  of  view  would  still 
legitimize  coercive  conmun ''ration.  Suchman  helps  clarify  this  point. 

"Our  everyday  pracuc.  writes  Suchman,  "render  the  social  world  publicly 
available  and  mutually  intelligible"  (Suchman,  1987).  Hence: 

1.  the  objectivity  of  the  physical  and  social  worlds  is  "the  product  of 
systematic  practices"  (Suchman,  1987). 

2.  the  source  of  the  mutual  intelligibility: 

a.  does  not  rest  un  "pre-existing  conceptual  schemes," 

b.  is  not  the  result  of  "a  set  of  coercive  rules  or  norms," 

c.  is  based  on  a  "common  practices  that  produce  typifications" 


The  best  way  to  help  learners  make  sense  out  of  their  learning  situations  is, 
therefore,  to  help  them  approach  the  learning  situation  as  ethnographers.  A 
learning  situation  is,  after  all,  a  kind  of  social  practice,  and  learners  are,  in  effect, 
in  the  position  of  field  workers  who  want  to  get  into  the  disciplinary  subculture's 
lore  of  knowledge.  Ethnomethodologies  are  useful  for  learners  because  they  deal 


(Suchman,  1987). 
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with  "how  members  of  a  group  make  sense"  and  "how...objectivity  and  mutual 
intelligibility  [are]  achieved"  (Suchman.  1987).  An  instructional  designer  who  wants 
to  address  the  constraints  of  situational  learning  will  therefore  have  to  find  ways 
of  creating  instructional  systems  that  give  learners  a  chance  to  act  as  ethnographers. 

Suchman's  final  proposition  about  plans  and  situated  actions  deals  with  how 
"Ianguage...[isJ  a  central  resource  for  achieving  the  objectivity  of  situations." 
(Suchman,  1987): 

Language  [she  writesj  is  a  form  of  situated  action  because  the 
Significance  of  an  expression  always  exceeds  the  meaning  of  what 
actuaUy  gets  said.  The  interpretation  of  an  expression  depends  not 
only  on  its  conventional  or  definitional  meanings,  not  on  that  plus 
some  body  of  proposition,  but  on  the  unspoken  situation  of  its  use. 

Hence,  plans  which  try  "to  guarantee  a  particular  interpretation"  by  providing 

"exhaustive  action  descriptions"  are  bound  to  fail  because  (Suchman,  1987): 

There  [arej  no  fixed  set  of  assumptions...or  background  knowledge 
that  underlie  a  given  statement...tHence]  mutual  intelligibility  is 
achieved  on  each  occasion  of  interaction  with  reference  to  situational 
particulars. 

Suchman  continues  by  claiming  that  "interpreting  the  significance  is  an 
essentially  collaborative'  achievement"  (Suchman,  1987).  Mutual  intelligibility,  in 
fact,  requires  smim  collaborative  conversation.  The  reasons  for  this  are  simple. 
The  significance  of  our  everyday  interactions  contain  inevitable  uncertainties  and 
our  language  ertails  inevitable  miscommunications.  The  only  way  to  catch  these 
uncertainties  and  repair  these  miscommunications  is  to  conduct  constant  and  in  sM 
conversations.  Interactive  instructional  systems,  even  those  that  use  artificial 
intelligence  technologies  to  model  the  communications  process,  are  of  no  help  here 
because  (Suchman,  1987): 

There  is  a  profound  and  persisting  asymmetry  between  people  and 
machines,  due  to  a  disparity  in  their  relative  ac-ess  ro  moment-by- 
moment  contingencies  that  constitute  the  conditions  of  situated 
actions. 

Human  teaching  and  learning,  therefore,  require  the  presence  of  face-to-face 
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linguistic  engagement.  Suchinan*s  conclusion  is  all  the  niore  significant  because  she 
applies  it  to  the  acquisition  of  a  simple  proceuural  skill  (i.e.»  how  to  use  a  Xerox 
machine). 

Joho  ScelY  BrowP^S  Eplsfemologv  of  Situated  Learning 

So  far,  I  have  described  Lucy  Suchman*s  theory  of  plans  and  situated 
actions,  and  applied  her  ideas  to  the  design  and  use  of  instructional  systems.  I 
would  now  like  to  end  with  a  brief  discussion  of  the  epistemology  of  situated 
learning  in  order  to  give  some  direction  for  further  work  in  this  area.  My  task  has 
is  made  easier  by  John  Seely  Brown  who  has  generalized  Lucy  Suchman*s  ideas. 

John  Scely  Brown  is  a  colleague  of  Lucy  Suchman  at  Xerox  PARC  and  one 
of  the  founders  of  the  field  of  Intelligent  Tutoring  Systems.  Intelligent  Tutoring 
Systems  are  the  most  sophisticated  forms  of  instructional  systems  and  incorporate 
ideas  from  cognitive  science,  computer  science,  and  artificial  intelligence. 

John  Seely  Brown  also  studied  how  human  beings  actually  learn  in  the 
presence  of  intelligent  tutoring  systems  and  concluded  that  Suchman^s  theory  of 
situated  action  was  a  more  adequate  account  of  the  phenomena  than  a  cognitive 
theory  of  plans.  He  therefore  began  to  formulate  an  epistemology  of  situational 
learning  that  is  sensitive  to  the  nature  of  situational  action. 

Brown  first  spells  out  how  ordinary  folks  think  about  real-world  problems. 
Ordinary  folks,  says  Brown,  (Brown,  1988): 

1.  act  on  concrete  situations, 

2.  resolve  emerging  dilemmas, 

3.  negotiate  the  meanings  of  terms  used  to  describe  new  situations, 

4.  and  ultimately  ;use  socially-constructed  plans  as  resources  for  each  new 
situation. 

Figure  9  summarizes  some  of  these  conclusions. 
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Insert  Figure  9  about  here 
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Brown  then  comparf  everyday  cognition  with  expert  cognition.  Experts, 
according  to  Brown,  are  persons  who  have  acquired  a  disciplinary  subculture  of 
knowledge  and  discourse-practice.    The  most  interesting  aspect  of  Brown's 
comparison  is  that  everyday  and  expe.t  cognition  have  very  much  in  cummv;. 
According  to  the  cognitivist  paradigm,  however,  expert  plans  and  procedures  are 
the  very  thing  that  distinguish  experts  from  ordinary  people.  According  to  Brown, 
on  the  other  hand,  the  only  difference  between  expert  and  ordinary  people  is  that 
experts  have  a  set  of  model  Hasmh  ynhish.  they  act  on  situations;  whereas,  just 
plain  folks  act  on  situations  with  partial,  and  often  incorrect,  models.  Both  experts 
and  ev^r.day  folks  mix  knowledge  with  use  and  belief  in  real- world  situations  and 
both  socially-constnict  the  objectivity  of  knowledge.  Furthe-more.  everyday  folks 
become  experts  through  a  socialization  process  of  acquiring  effective  discourse- 
practices  in  situated  actions  just  as  experts  do.   Everyday  folks  do  not  become 
experts  by  acquiring  expert  knowledge  or  following  expert  rules  (Dreyfus  & 
Dreyfus,  1986) 

Brown  then  spoils  out  the  epistemological  shifts  that  take  place  when  we 
move  from  a  cognitivist  paradigm  to  a  situated  learning  paradigm.  Figure  10 
summarizes  these  shifti  (Brown.  1988).  I  will  only  highlight  those  aspt^cts  of  the 
paradigm  shift  that  have  a  direct  bearing  on  At  design  of  instructional  systen-s. 


Insert  Figi>  i  10  about  here 


The  most  obvious  epistemological  shift  is  from  knowledge  to  practice. 
Learning  is  no  longer  a  matter  of  ingesting  externally-defined,  decontextualiied 
objects,  but  a  matter  of  developing  context-bound  discourse-practices.  This  means 
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the  objectives  of  an  instructional  system  can  no  longer  be  seen  as  a  pre-defined 
end- point  for  learning,  nor  instructional  tasks  as  a  s1D£  flua  nOR  of  instructional 
interaction.  Rather,  objectives  can  only  be  seen  as  expectancies  that  constrain  the 
direction  the  learner  is  going,  and  instructional  tas.Vs  can  only  be  seen  as  one  of 
many  activities  the  learner  might  choose  io  pursue. 

The  second  epistemological  shift  is  from  problem-solving  to  dilemma- 
handling.  This  means  that  learning  can  no  longer  be  viewed  as  a  form  of  cognitive 
problem  solving,  but  as  a  form  of  posing  problems,  formulating  hypotheses  and 
terms  to  handle  the  problem,  negotiating  criteria  to  evaluate  the  problem,  and 
finall/  interpersonally  resolving  the  problem.  In  some  ways,  the  v^^ry  word 
"problem"  is  inadequate  in  the  situated  learning  paradigm  because  it  reduces  real- 
world  dilemmas  to  cognitive  puzzles  that  have  an  explicit  solution  built  into  them. 
Hence,  the  word  "dilemma-handling"  is  a  more  adequate  term. 

The  final  shift  that  I  want  to  mention  involves  the  move  from  efficiency 
to  rationality.  Cognitive-based  instructional  systems,  as  I  have  shown  in  an  earlier 
paper,  are  ultimately  shaped  by  the  economic  criteria  of  systems  efficiency  rather 
than  the  qualitative  criteria  of  excellence  and  substantive  understanding  (Streibel, 
1986).  Cognitive-based  instructional  systems,  therefore,  serve  the  "human  interests" 
of  someone  other  that  the  learner  (Apple,  1975;  Wolcott,  1977;  Bullough,  Goldstein, 
&  Holt,  1984).  In  the  situated  learning  paradigm,  however,  the  learner  is  at  the 
center  of  negotiating  the  meaning  of  their  actions  and  therefore  at  the  center  of 
negotiating  what  is  rational  to  th^  :i.  An  instructional  system  that  is  sensitive  to 
the  situated  learning  paradigm  has  to  respect  and  encourage  the  very  social- 
linguistic  procc;Sses  by  which  rationality  is  constructed.  This  is  a  tall  order  for 
instructional  systems,  even  those  as  advanced  a  intelligent  tutoring  systems, 
because  such  systems  have  a  very  limited  access  to  the  "moment-by-moment 
contingencies  that  constitute  the  conditions  of  situated  actions  (Suchman,  1987). 
It  is,  however,  a  challenrt  that  we  as  instructional  designers  will  have  meet  if  we 


19 

56i 


550 


are  to  respect  the  way  humaa  tjings  actually  learn. 
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The  present  research  study  is  an  extension,  and 
further  refinement  of  a  series  of  studies  completed  by  the 
au*-.hors  on  micro-computer  based  instruction  (MCBI)  and 
cognition.    Each  of  these  research  studies  was  designed  to 
examine  learning  strategies  and  program  embedded  cognitive 
strategies  to  improve  learning  from  MCBI.    The  first  study 
examined  a  general  learning  strategy  of  program  pacing, 
external-paced  versus  self-paced  (Beliand,  et  al  1985). 
While  much  of  MCBI  is  oriented  to  provide  self-paced 
instruction  to  adjust  for  individual  differences,  there  is 
some  indication  from  cognitive  theory  that  self-paced  may 
not  be  the  best  approach.     For  e-c^mple,  Wittrock  (1979) 
noted  that  attention  and  motivation  are  key  cognitive 
variables,  indicating  that  as  they  are  increased  to  optimal 
levels  learning  improves.    Carrier  also  found  that  learners 
may  not  be  the  best  judge  of  what  to  learn,  when  to  learn, 
or  how  to  learn  new  material  (1984).    The  results  of  our 
first  study  supported  these  findings  indicating  that 
moderate  levels  of  external  pacing  in  the  MCBI 
instructional  program  improves  the  amount  learned  and  the 
competency  level  in  using  new  material  over  self-paced 
MCBI. 

Based  upon  these  initial  results,  and  research 
findings  on  other  types  of  cognitive  learning  strategies 
(O'Neil  1978;  O'Neil  &  Speilberger,  1978),  two  studies  were 
designed  to  examine  the  effects  of  cognitive  strategies 
(Canelos,  et  al,  1986;  Taylor,  et  al,  1987).     If  a  pacing 
strategy  could  improve  learning  it  is  likely  that  a 
cognitive  strategy,  based  upon  fundamental  cognitive 
processes,  could  provide  additional  learning  benefits  when 
learning  from  MCBI.    Two  ?reas  of  research  were  considered 
to  determine  the  types  of  learning  strategies  to  be 
evalua^-ed.    The  first  was  the  research  on  imagery  mediation 
(Paivio,  1970),  the  second  on  meaningful  learning  theory 
involving  attention  directing  strategies  (Ausubel,  1968). 

Cognitive  imagery  mediation  research  has  a  long 
history  stemming  from  early  wonc  by  Paivio  (1970), 
Harowitz  (1970),  and  others,  to  current  work  on  imagery 
learning  strategies  (Dansereau,  1978;  Kosslyn,  1975). 
Imagery  learning  strp.tegies,  based  upon  imagery  mediation, 
tend  to  significantly  improve  learning  and  later  recall 
over  the  learner's  own  basic  memory  strategies.  Similarly, 
research  on  attention  directing  strategies  has  indicated 
that  learning  can  be  improved  significantly  if  learners  are 
provided  strategies  that  improve  attending  behaviors  thus 
helping  them  separate  relevant  from  background  information 
(Rothkopf,  1967)      This  research  base  led  to  the 
development  >f  two  program  embedded  learning  strategies: 
the  imagery  cue  strategy,  and  th  -  attention  diiecting 
strategy.    These  two  strategies  were  evaluated  in  our  next 
two  MCBI  studies,  presented  at  che  1986  and  1987  WECT 
conferences. 
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The  1986  (Canelos,  et  al)  and  1987  (Taylor,  et  al) 
studies  evaluated  learning  from  MCBI,  with  the  added 
effects  of  the  imagery  cue  strategy  and  an  attention 
directing  strategy.     Both  of  these  strategies  were 
program  embedded,  indicating  that  the  learner  did  not 
have  to  learn  a  strategy,  but  used  the  strategy  while 
working  through  the  MCBI  program.    These  strategies  are 
described  in  detail  in  Taylor,  et  al  (1987).     Results  of 
this  1987  sjtudy  on  MCBI,  and  program  embedded  learning 
strategies  indicated  that  the  imagery  cue  strategy 
significantly  improved  learning,  as  did  the  attention 
directing  strategy.     However,  the  imagery  cue  strategy 
seemed  to  be  more  effective  overall,  particularly  for 
spatial  tasks.    An  additional  finding  wap  that  an 
external-paced  MCBI  condition  was  better  overall,  when 
using  program  embedded  learning  strategies.    While  these 
first  three  studies  allowed  the  refinement  and 
development  of  MCBI  pacing  strategies,  and  program 
embedded  learning  strategies,  the  effects  of  testing 
needs  to  oe  further  examined.    The  research  on  encoding 
specificity  has  indicated  that  there  is  a  significant 
interaction  between  elements  in  instructional 
conditions,  end  testing  (Tulving,  1979).     For  example, 
if  visuals  are  a  significant  part  of  instruction,  but  do 
not  occur  during  testing,  performance  can  be  adversely 
effected  (Canelos,  et  al,  1985). 

The  present  study  will  further  examine  the 
effectiveness  of  an  imagery  program  cjmbedded  learning 
strategy,  and  an  attention  directing  program  embedded 
learning  strategy,  when  learning  from  MCBI.     Hov^ever,  this 
study  will  evaluate  '"he  relationship  between  MCBI  program 
embedded  strategy  use  and  a  visual  testing  method  and 
verbal  testing  method.    The  following  research  hypothesis 
will  be  evaluated  by  the  experimental  design  in  Figure  1. 

1)  The  program  embedded  cognitive  strategies  will  allow 
learne      to  acquire  more  information  from  the  MCBI 
progr    ,,  than  their  own  cognitive  strategies. 

2)  The  imagery  cue  program  embedded  learning  strategy  will 
be  more  effective  overall  for  learning,  than  the 
attention  directing  strategy. 

3)  Verbal  and  visual  testing  will  interact  with  learning 
strategy  tyoe,  yielding  an  encoding  specifity 
relationship^ . 

4)  Verbal  and  visual  testing  will  interact  with  the  level 
of  testing  difficulty. 
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Experimental  Design 


Figure  1  outlines  the  experimental  design  used  in  this 
study.     The  MCBI     instructional  programs  will  instruct 
learners  on  the  parts  and  operations  of  the  human  heart. 
There  are  57  instructional  frames  in  each  program, 
consisting  of  a  visual,  verbal  labels,  a  brief  verbal 
description,  activity  questions,  then  feedback.    The  basic 
design  of  each  MCBI  program  will  use  an  externally  paced 
learning  strategy.     Two  of  the  MCBI  conditions  will  include 
program  embedded  learning  strategies.    One  MCBJ  condition 
will  have  an  imagery  cue  strategy.     The  second  program 
embedded  strategy  will  be  the  attention  directing  strategy. 

1 )  Externally  Paced  Program 

The  first  instructional  condition  was  externally  paced. 
The  external  pacing  began  after  the  instructional  display 
vas  completed.    After  each  instructional  display  was 
completed,  the  computer  timed  the  student's  interaction 
with  the  completed  display  at  a  pace  of:     (1)     one  second 
per  each  line  of  verbrl  instruction,  plus  one  second;  so 
for  five  lines,  six  seconds  for  reading  were  given,  (b) 
seven  seconds  for  cognitive  processing  were  then  given;  (c) 
aftei  reading  time  and  cognitive  processing  time  had 
elapsed,  the  instructional  display  was  removed  from  the 
terminal  screen. 

To  move  forward,  the  learner  pressed  the  return  key  to 
receive  the  activity  question.    The  learner  had  as  much 
time  as  required  to  respond.     If  the  correct  answer  was 
enterea,  simple  feedback  was  given  and  the  student  moved  to 
the  next  instructional  display.     If  the  incorrect  answer 
was  typed  in^  simple  feedback  was  given  that  indicated  an 
incorrect  answer.    The  learner  was  given  the  option  of 
receiving  elaborate  feedback,  which  was  the  repeat  of  the 
instructional  display  containing  the  required  answer.  The 
elaborate  feedback  wus  optional;  the  learner  could  move  to 
the  next  instructional  display  or  take  feedback.  Feedback 
was  a  repeat  of  the  instructional  display  and  was  timed  the 
same  way . 

2)  Externally  Paced  Plus  Imagery  Cue  Strategy 

The  second  instructional  condition  was  identical  to 
the  first  instructional  condition,  but  with  the  addition  of 
the  program  embedded  strategy  of  an  imagery  cue  strategy. 
The  instructional  content  and  content  sequence"  were 
identical.    The  imagery  cue  strategy  was  presented  in  - 
program  embedded  format.    The  imagery  cue  strategy  was  v 
special  screen  display  occurring  every  5-7  instructional 
displays,  prompting  the  learner  to  form  a  mental  image  of 
the  heart  parts  seen  thus  far. 
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3)     Externally  Paced  Plus  Attention  Directing  Strategy 


The  third  instructional  condition  was  identical  to  the 
first  instructional  condition,  in  terms  of  content  and 
content  sequence,  but  with  the  addition  of  the  attention 
directing  strategy.    The  attention  directing  strategy  was  a 
program  embedded  strategy.    The  attention  directing 
strategy  vas  a  five  second  time  delay  which  occurred  in 
each  instructional  display,  between  the  presentation  of 
spetial  information  and  the  accompanying  verbal  descriptive 
information.    This  tended  to  increase  attention  to  the 
visual  information  in  the  instructional  display. 

The  testing  condition  in  the  experimental  design  has 
five  visual  and  verbal  tests  to  evaluate  performance  on 
five  intellectual  skills:     list  learning,  simple  concept 
learning,  complex  concept  learning,  cued  recall,  and 
problem  solving.    All  testing  at  one  level  is  visual, 
involving  either  a  visual  cue,  visual  problem  or  spatial 
relationship.     In  the  second  level  of  the  testing  condition 
all  tests  are  verbal  using  either  multiple  choice,  or 
requiring  a  verbal  description  to  complete  a  problem.  The 
visual  and  verbal  tests  evaluate  performance  on  the  same 
intellectual  skills,  with  tept  items  on  each  test  being 
isomorphic.     Each  of  the  five  tests  has  20  possible  points. 
The  only  difference  between  the  testing  conditions  is  the 
use  of  either  visual  or  verbal  information  in  the  way  the 
test  item  is  structured  and  presented  to  the  learner. 

Verbal  Testing  Conditions 

1)  List  Learning  Tasks 

The  list  learning  task  was  a  simple  memory  task, 
requiring  the  learner  to  list  the  names  of  the  parts  of  the 
heart  and  phase  i.ames. 

2)  Cued-Recall  Task,  Verbal  Orientation 

The  cued-recall  task  consisted  of  20  multiple  choice 
items  designed  to  test  the  learning  of  heart  part  locations. 
The  test  contained  a  line  drawing  of  the  heart  with  numbers 
and  arrows  indicating  where  each  part  was  located.    The  20 
multiple  choice  verbal  test  items  appeared  under  the 
numbered  drawing  and  required  the  subject  to  identify 
specific  parts  and  locations.    While  there  was  a  spatial 
cue  given,  the  structure  of  each  test  item  was  verbal 
multiple  choice. 


580 


Sample  Item 


Arrow  number  eight  (8)  points  to  the 


a . 

pericardium 

b. 

endocardium 

c. 

ectocardium 

d. 

ectoderm 

e. 

myocardium 

3) 

Simple  Concept  Learning  Task 

In  each  item  stem,  the  simple  concept  learning  task 
items  provided  a  description  of  a  critical  attribute  about  a 
heart  part  or  operation.    The  learner  selected  the  the  heart 
part  name  or  operation  name  from  the  available  choices. 

Sample  Item 

The    is  the  name  given  to  the  inside 

lining  of  the  heart  wall. 

a.  epicardium 

b.  endocardium 

c.  pericardium 

d.  myocardium 

e.  septum 

4)  Complex  Concept  Learning  Task 

The  complex  concept  learning  task  items  weiTe  complex  ii 
the  sense  that  they  involved  "if-then"  relationships  of  the 
parts  of  the  heart  during  heart  operation. 

Sample  Item 

When  blood  is  entering  through  the  vena  cava?  it  is  also 
entering  through  the 

a.  mitral  valve 

b.  pulmonary  veins 

c.  pulmonary  artery 

d.  aortic  arch 

e.  aorta 

5)  Problem  Tafk  Verbal,  Free-Recall 

The  problem  task  verbal  free  recall  was  considered  the 
most  difficult  of  the  five  verbal  tasks.    The  learner  bad  to 
prepare  from  memory  a  detailed  written  description  of  tue 
heart,  with  the  parts  described  in  the  correct  location  and 
function  as  to  how  they  operate.    The  learner  has  to  also 
describe  b]ood  flow  through  the  heart  pump  system  and  the 
heart  phases.    There  were  20  possible  points  on  this  task. 
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visual  Testing  Conditions 

1 )  List  Learning  Task 

This  task  was  the  sa:ne  for  both  typns  of  testing, 
thus  serviny  as  a  testing  control  for  both  groups, 
visual  and  verbal. 

2)  Cued-Recall  Task,  Visual  Orientation 

This  task  was  visual  in  nature,  but  reguired 
similar  knowledge  as  in  its  verbal  task  counterpart. 
The  learner  had  to  identify  a  heart  part  location,  but 
in  this  case  the  test  item  was  completely  visual  in 
structure. 


S«lect  the  letter  which  correctly  represents  the  part  or  function 
of  the  heart  described  in  each  question. 


myocardium 


left  ventricle 


3)     Simpl-3  Concept  Learning  Task 

Again  this  task  required  similar  knowledge  as  its 
verbal  counterpart,  but  was  visual  in  structure. 

Select  the  answer  you  feel  best  Identifies  the  part  of  the 
heart  Indicated  by  the  numbered  arrows  and  mark  the 
corresponding  letter  on  the  provided  answer  sheet.  A11 
responses  should  be  .nade  in  pencil. 


32.    The  inside  lining  of  the 
heart  well: 


33.    The  pertCs)  of  the  heart 
through  vhich  ieoxygenated 
blood  enters: 


4 )     Complex  Concept  Task 


This  task  required  the  same  knowledge  of  "if-then" 
relationships  as  itr  verbal  counterpart,  but  was  visual  in 
structure . 

44.    Tb'    art  of  the  heart  in  which  the  contraction  impulse  starts: 


5)     Problem  Task  Visual,  Free  Recall 

The  problem  task  visual  free  recall  was  considered  the 
most  difficult  of  the  five  tasks.     The  learner  had  to 
prepare  from  memory  a  line  drawing  of  the  heart  with  the 
parts  indicated  and  in  the  correct  location  and  labeled. 
Then  the  learner  had  to  indicate  blood  flow  ♦'hrough  the 
heart  pump  syrteip  by  drawing  a  series  of  dotted  lines 
showing  how  the  parts  interact  during  heart  operation,  and 
then  had  to  indicated  the  heart  phases.     Similar  to  the 
other  learning  tasks,  there  were  20  possible  points  on  this 
task. 

Procedures 

There  were  78  subjects  participating,  in  this  study, 
having  13  subjects  in  each  independent  group.  Subjects 
were  undergraduates  enrolled  in  College  of  Education  at 
Ohio  State  University.     Subjects  were  randomly  assigned  to 
one  of  the  six  independent  groups  in  the  study  from  a 
sign-uo  sheet. 

On  the  day  of  the  study  subjects  in  each  group  were 
given  a  brief  introduction  about  what  they  would  be  doing 
and  then  assigned  to  the  computer  cent^  '  to  work  through 
the  instructional  programs.     Subjects  then  went  to  a 
testing  room,  where  they  were  given  the  five  tests.  Tests 
were  given  in  an  order  so  that  cues  were  not"  given  for 
other  tests.     Subjects  were  not  aware  that  there  were  two 
basic  types  of  testing,  visual  and  verbal. 
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Data  Analysis  and  Conclusions 


Data  collected  have  been  analyzed  using  an  analysis 
of  variance  procedure  with  repeated  measures  (ANOVR). 
Table  1  gives  the  summary  results  of  the  ANOVR.     Table  2 
provides  the  resulting  main  effect  and  simple  effect 
means,  with  figure  2  providing  a  graph  of  the  resulting 
significant  interaction  between  MCBI,  testing,  and  test 
difficulty. 

This  interaction  indicated  that  subjects  without  the 
learning  strategies,  in  the  EP  group  did  not  perform  as 
well  on  visual  testing  as  on  verl-^cl  testing. 
Additionally,  the  image  cue  strategy  and  attention 
directing  strategy  improved  performance  slightly  on  both 
visual  and  verbal  testing.     However,  the  EP  no  strategy 
group  performed  well  on  the  verbal  testing  condition  and 
slightly  better  than  the  strategy  groups.     There  was  a 
slight  encoding  specificity  effect  between  visual  and 
verbal  testing  with  the  EP  no  strategy  group.    Adding  the 
program  embedded  strategies  did  slightly  improve  learning 
as  was  expected,  but  there  are  some  cautions  within  the 
context  of  the  present  study. 

It  should  be  noted  that  this  three  way  interaction 
is  borderline  statistically  significant,  at  [.0571.  This 
[.057]  or  (.06]  value  is  not  typically  accepted  as  a 
statistically  significant  value.     However,  this  study 
represents  a  preliminary  study  on  visual  and  verbal 
testing  with  the  three  varied  MCBI  conditions.     The  small 
number  of  subjects  in  each  independent  cell  of  only  13, 
probably  added  to  this  result,  and  the  other 
insignificant  interactions.     An  additional  problem  with 
the  experimen^al  design  is  the  use  of  an  immediate 
testing  condition.     It  is  likely  that  the  addition  of  a 
second  within  subjects  variable  of  a  one-week  delayed 
testing  condition  would  yield  significatit  results  on  the 
main  effects  of  MCBI  type  and  visual  versus  verbal 
testing,  along  with  significant  interactions. 

The  hypotheses  were  not  supported  by  these  results 
probably  because  of  the  low  number  in  each  independent 
cell.     Additionally,  the  one-week  delay  measure  on 
testing  could  eliminate  the  effects  of  immediate  memory 
and  possibly  yield  significant  results  on  both  main 
effects  and  interactions.    While  the  results  were 
generally  statistically  insignificant  the  study  should 
not  be  considered  a  completf*  loss.    The  experimenters 
were  able  to  further  refine  the  MCBI  instructional 
programs,  the  visual  testing  condition,  and  found  that 
program  embedded  strategies  are  beneficial. 
Additionally,  the  experimenters  plan  to  repeat  this  study 
with  an  increased  number  of  subjects  in  each  indepdendent 
cell,  and  the  addition  of  a  one-week  delayed  testing 
variable.     The  next  study  will  be  a  (3x2x5x2)  ANOVR 
experimental  design,  with  the  same  two  between  subject 
variables  and  two  within  subject  variables,  adding 
delayed  testing.  KtiA 
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While  there  is  a  good  deal  of  pressure  for 
researchers  to  produce  significant  results,  it  is 
necessary  to  conduct  preliminary  research  to  evaluate 
instructional  and  testing  conditions,  subject  behavior, 
experimental  designs,  and  experimental  procedures.  This 
situation  is  well  known  in  the  area  of  science,  medicine, 
and  engineering,  where  a  line  of  inquiry  may  yield  a 
series  of  studies  with  only  minor  refinements,  eventually 
leading  to  significant  results  over  the  long  run. 
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2 

Oognltlve  Sclenoe  and  Instructional  Tachnology: 
lBfaxNW0r±a  In  Highai^Qnler  Ihiriking  Strategies 

A  recent  national  report  on  education  ooncl\x3ed  that  society's  fixture 
depends  on  a  citizenry  that  can  '*tidhk  and  reason  cceatlvely  and  deliberately; 
develop  sound  jixSgnsnts  of  infoonation  (and)  understand  and  contend  effectively 
witn  rapid  and  constant  change.. (ISatlonal  Omission,  1983) .   IdJoeidse,  a 
national  teacher  education  taedc  force  urged  the  develcEsment  of  a  curriculton 
"that  enihaslzes  hig(her^order  thlifldng  strategies**  (Itational  Task  Force, 
1986) .   In  other  wofrds,  the  purpose  of  education  should  include  not  only  the 
acquisition  of  knovledgie,  but  also  the  dsvelopnent  and  iaprovement  of  hi^lher- 
order  cognitive  processes.  Uhfortunately,  the  achievement  of  these  learning 
goals  still  elude  educatoni  erven  after  decades  of  concern  because  of  ttm 
serious  lack  of  basic  research  on  instructional  strategiee  that  can  enpirlcally 
daacg^trate  the  iaproved  learning  of  higher-order  thinking  strategies. 

Houever,  in  the  last  decade  developooents  in  cognitive  sclenoe  have  forged 
interdisciplinary  arproaches  to  learning  and  thinking  such  that  w  noi  seem  to 
understand  more  about       and  %fey  people  both  acquire  knowledge  and  employ  it 
in  the  service  of  problem  solving  (Gagne  &  Glaser,  1987) .   Ihese  advancements, 
in  Jdhat  can  be  called  oogialtlve  learning  theories  (Temtyson  &  Christensen, 
1988) ,  offer  a  means  to  not  only  more  fially  understand  learning  and  thinking 
processes  but  they  also  provide  the  means  necessary  for  prescribing 
instmctional  strategies  that  can  predictably  iaoprove  these  cognitive  processes 
(Wertheimer,  1985). 

Higher^<3rder  thinking  involves  cognitive  processes  directly  associated 
with  the  enployment  of  knowledge  in  the  service  of  problem  solving  and 
creativity  (Gagne,  1985) .   Basically,  these  processes  enable  the  individual  to 
^^restructure**  their  knobdedge  fay  (a)  analyzing  a  given  situation,  (b)  wnddng 
out  a  conoeptuallzatlcn  of  tiie  situation,  (c)  defining  epedfic  goals  for 
coping  with  the  sltuatlcn,  and  (d)  establishing  a  possible  solution  (Brsuer  & 
Hajovy,  1987). 

OoBplex  problem  si]m,llfltlCflP    'Dm  purpose  of  this  pap^  is  to  present  an 
instnictlonal  mettxxl  that  has  been  eepirlcally  ihom  to  significantly  isprove 
higher^-order  thinking  strategies  (i.e. ,  problem  solving) .  Ohe  method  ^loys 
ccBputer^^nanaged  sisulatlons  that  prooont  conteKtually  meaningfial  problem 
situations  that  require  students  to  prepare  solution  proposals.   The  sinulatlon 
asseaaes  the  proposal  and  offers  the  students  ttm  oonseguences  of  thair 
decisions  while  also  Iteratlvely  updating  the  situaticrrl  condltiora.  Ihis 
type  of  siaulatlon,  unlike  orciventional  siamlations  vAilch  are  used  for  the 
aoqaisitlon  of  knowledge,  prasents  <!^ynamic  problems,  requiring  the  students  to 
fully  employ  their  knowlediga  base  fay  generating  solutions  to  domain-epeclf  Ic 
problems  (Bransford  &  Stein,  1984) . 

In  this  pe^wr  I  will  first  elaborate  on  the  cognitive  processes  associated 
with  hlc(her^<arder  thihking  strategies  so  as  to  more  clearly  define  the 
prescribed  instructional  method  to  isspraw  problem  solving.   Follddng  that 
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presentation,  I  will  describe  the  Instructional  strategy  and,  finally,  present 
software  exasoples  of  the  method. 

Leeoning  and  Cognition 

An  Inportant  oontrlhution  of  cognitive  psydtblogy  In  the  past  decade  has 
been  the  developnartt  of  theories  and  models  to  eoqilain  the  processes  of 
learning  jnd  cognition  (Streufert,  Stwufert,  &  Demon,  1985) .   The  value  of 
these  theories  is  that  they  offer  operational  definitions  of  not  only  how 
learning  oocurBtMt  **y  it  occurs.   Ihe  why  eo^Jlanation  provides  more  direct 
means  for  understanding  how  Instructional  strategies  may  acocnpliah  predictable 
laprovanants  in  both  learning  and  thiridi^. 

m  this  section  I  present  an  overview  of  a  learning  and  cognition  model 

J?Ji5!!5^^S®,5®^*"^''***^  proposed  imtructional  method  and 

nigher^^arder  thinking  strategies  (Tennyscn  &  Christeraen,  1988) .   Figure  1 
ehowB  that  the  acquisition  of  knowledge  ocnes  fron  both  oxtetnal  and  internal 
aouroes.   This  is  an  lusxartant  conoept  to  the  iawtructional  Issue  of  developing 
and  ixeprovlng  hi^^Mr^order  thihking  strategies  beosuse  most  cognitive  theories 
assune  these  processes  to  be  controlled  by  Irtsmal  cognitive  systans.  That 
is,  to  opeLationally  aooount  for  then,  it  is  naoessary  to  coraider 
Instructicnal  strategies  that  induda  direct  xeftarence  to  internal  cognitive 
systett  1  as  well  as  ones  that  always  rely  on  learning  as  occurring  fran 
external  sources  only  (Anderson,  1980,  1982) .   The  basic  cckiponents  of  our 
cognitive  system  model  include  the  following:   sensory  receptors  (i.e.,  eyes, 
ears,  touch,  etc.),  perception,  short-term  and  worklng^menKay,  and  loncj-term 
menory  (storage  and  retrieval) . 


Insert  Figure  1  about  here 


fSESSti&D.   mfomation  ocming  from  either  external  or  internal  sources 
passes  throucjh  the  perception  conponent  which  perf onw  the  function  of  being 
a»«re  of  and  assessing  the  potential  value  of  the  information  for  purposes  of 
attention  and  effort  in  cognitive  processing  (Doemer,  1983) . 

^  _  jl??^'''^^  fflfl  WtH^  memory.   The  next  ccnponsnt  consists  of  two  foms 
of  memory  that  only  deal  with  Innadiate  cognitive  processes:  short-term  menory 
f^^iiSrT^J*^*  Short-term  memory  is  defined  as  having  a  limited  capacity 
in  vhich  information  is  maintained  only  for  the  moment  at  hand  (actually  only 
a  few  seconds  at  maxiiami) .   Working  maooy  on  the  other  hand  Involves  conscious 
aMot  or  metaoognltive  awareness  of  the  encoding  process  between  itself  and 
long-term  menory  (Brown,  Ambruster,  &  Baker,  1984) . 

Iflnq-t«a  naaeOf.   The  acgolsition  of  information  (learning)  and  the 
means  to  enploy  it  (thinking)  occurs  within  the  storage  and  retrieval  sub- 
systems of  the  long-term  memory  ocnponent.  The  storage  system  is  where  new 
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Itifonnatlcn  Is  learned  and  aFwlTnllnterl  into  the  esdsting  knowledge  base.  A 
kncwledge  base  can  be  described  as  an  associative  network  of  ocnxpts  (or 
sdhsDias)  varying  per  individual  acoatding  to  amount,  occpmizaticn,  and 
acxsesslbillty  of  its  infoanatlon  (Babinowitz  &  Glaser,  1985) . 

Ihe  retrieval  syBten  involves  the  twofold  cognitive  process  of  selecting 
and  organizing  knowledge  for  puxposee  associated  with  a  ^ven  situation.  Itiat 
is,  the  fomar  process  differentiates  knowledge  in  memoey  based  i^xn  criteria 
for  selecticn,  while  the  latter  process  integrates  the  knowledge  for  serving 
the  given  need  (Sciiroder  6  Suedfeld,  1971) .   It  is  in  the  retrieval  system 
that  VB  are  most  concerned  with  when  considaring  instructicnal  strategies  to 
inpxive  higherMxrder  thinking  prooesaes.   m  Figure  2,  we  Illustrate  the 
distinctlcns  beb^ven  the  two  sUb-systeooe  of  long-term  menary. 


insert  Figure  2  about  here 


Within  the  storage  system  of  memory  there  are  various  foms  of  knowledge: 
declarative,  procedural,  and  contextual  (Shiffrin  &  Dumais,  1981) .   Each  fom 
represents  a  different  memory  system  or  function.   Declarative  knowledge 
loplies  an  vnderstanding  and  awareness  of  infomation  and  refers  to  the 
"toYxtinj  that,"  for  exaiiple,  that  underlining  keywords  in  a  text  will  help 
recall.   Procedural  knowledge  ijoplles  a  *iknawing  how"  to  enploy  oonoepts, 
niles,  and  principles  in  the  service  of  gl*«en  situations.   Oontextual  knowledge 
ioplies  an  understanding  of  viien  and  why  to  select  specific  concepts,  rules, 
principles  fkon  the  knowledge  base.   The  selection  process  is  governed  by 
criteria  (e.g. ,  values  and  situational  atiiiroprlateness) .  Mwreas  both 
declarative  and  procedural  knowledge  fbcm  the  amount  of  information  in  a 
knowledge  base,  contextual  knowledge  fonos  its  orgemizatlon  and  accessibility. 

Ihe  retrieval  efystem  of  memocy  «D|>lcy8  the  knowledge  base  fbr  the 
thinking  strategies  nsfywiated  with  recall,  problem  solving,  and  creativity 
(see  Figure  2) .  Recall  siaftly  iiplies  the  automatic  selecting  of  knowledge 
directly  as  stared  in  memory.   Problem  solving  involves  more  conplex  thirddng 
strategies  that  require  both  the  cognitive  processes  of  differentiation  and 
Integration  (restructing)  of  information  from  the  knowledge  base.  Creativity 
is  the  hi^(hest  ozdsr  of  thinking  because  it  iaplies  the  creating  of  knowledge 
as  well  as  the  eaoDplqyment  of  the  cognitive  processes  of  differentiation  and 
integration. 

Cognitive  OcBPlexlty 

Hl^lher-order  thinking  involves  three  occ^nitive  processee:  differentiation, 
Intagratlon,  and  creation  of  knowledge.   Ihe  first  two  processes  occur 
primarily  in  the  retrieval  system  of  memory  \Mle  the  third  further  involves 
the  other  ccnponents  of  the  entire  cognitive  system  (see  Figure  1) . 

Ihe  operational  term  for  the  retrieval  system  functions  of  differentlatlot> 
and  integration  is  ooanitlve  ocBPlexlty  (Schroder,  1971) .  Cognitive 
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SSSS?;JS4jf*f^  ^  S??^^^^  fleas  to  be  iwtB  of  a  trait 

SSS^TLSSiJ^  '4!!  "L!5P*y  *^  can  be  developed  and  inproved  ^^th 

SJf^^^    Diff««itl»'tion  is  defined  as  a  twofold 
^^^JS'^J'J^'^'  "^^^^  ^  understand  a  given  situation; 

KLfflL?il54i*^  *°  *^  apprcprlate  criteria  by  «hich  to  select  necessary 
mwigiBfty  etatage.   Ditagraticn  is  the  pcooeBS  of  fomlng  nev  sd)eBna(s) 

SfJSirSS  £l?^**^-..?~*^'^*y  ^      P'=«*"  to  fom  new  toowledge  by 
•qplGylngr  the  total  cognitive  systen. 

r«v,5*5*3fe*-?i?  ^'''S??!!^**'**  <»i«tomMatifln  praaees  is  the 

2^2Sf-5l.*^^}!L.4**^*^^  fltandards  or  values  by  %(hlch  a  judgment 
S^i2SiS^Slj?it^J?^  a»  an  Integral  attrlbutiof 

origxbj^tawledgi  (Barls,  cross,  4  Lipscn,  1984).  However,  in  higher-order 
tt^tog^to^^  to  be  devel^  withln'the  SSST^ 

!R  J5y™Ly*  pmoessM.   Beoause  aiaiv  hl^MMsrder  thinking 

SSSiSJf^  T'^y  right  or  wrcfig'cSSlalbr^knoS^ 

SnSSSfiZi  functional  or  aoral  reasoning  need  tobe 

an  integral  part  of  mach  problem  solving  and  creative  situations. 


points 


itehiJSSi^/SifTSSi  ^^.""'^PO'aiy  reaearcij  in  cognitive  ocnplexity 

"S??J®5~^  '  •  R*lbe51onsiders 

S^iSJ?S?,"J!L"**^*^  that  can  be  developed  and,  as  HUnt  (1975)  poi 

22S!S!Li^"SL!^????.?~'  we  need  to  consider  c-ily  Kohlberg's 
S5S5S^,fl*i2Sf!l!!l^^  a»i«lly'       oonventlSnal  level 

^^^2?^'^^^'°^  9W«tal  eociety,  either  in  tenns  of 

SSSX SS?"***^  If!?  "**  n»  poetoonventional  level  focuses  cn 

SSSS^^i.fES^^Sf'  ^  *^  ^         o«  principles  they 

Aooflfl  to  ftdl€W  (Note.  Stage  5,  axe  standards  usually  agreed  upon  by  society, 
**dle  Stage  6,  are  self-choeen  standards).  ^  «»iecy, 


J^*»v»<5«fln«d  cognitive  coRplejdty  as  an  ability  that  can  be  iaproved 
ilLiS'.'^^^r"^^  oonelated  to  inteUigenoe  (Siaon,  1980). 
M^^^^L'^SSSJ!^^'        int«lligmoe  needs  to  be  considered  alot^ 

their  fUU  potarttlal  in  all  possible  areas  of  knovledge  (Flavell,  1977) .  ihat 
iJ^tte  wmm  flaUy  developed  the  knoirlec^rn  base  in  nmory,  the  greater  the 
SSSi^iSl^-S^TZSi^  ^tion,  and,  poeeibly,  creation  of 

S22^;K4i^*!2?^  ^  °^  theories  of  intelllgenoe  is  beyond  the 

<«^.-??!LS2?P°5!2LY2?     Gather  (1984)  updates  the  notion  of  aultiple 
J2«*lig«Me  by  idmtiiying  seven  largely  autononeus  kinds  of  human 
incjlllW       adi  tands  to  have  its  own  original  location  in  the  brain, 
25r!!?  <=n  i*«       flchedule  in  the  notmal  develofiient  of  the  brain  and 
eaca  functions  uni«»aely.   Gardner's  seven  intelllgencee  are  linguistic, 
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Buslcal,  loglcal^mathmatlcal,  spatial,  bodily^kinesthstlc,  :       ptlcn  of 
self,  and  sense  of  others.   Ifaa  first  four  form  the  intelllgbi^k^s  ^ch  are 
most  associated  with  cognitive  pcooesslng,  bat  the  latter  two  are  ^jqportant  for 
developwnt  of  crlterlal  values  integral  to  dif fentitiaticn. 

Ihe  cognitive  porooesses  of  differentiation,  jjitegratlon,  and  creation  of 
knowledge  are  abilities  that  can  be  iapxived  by  effective  instiizctlonal 
strategies.   liitelligenae,  on  the  other  hand,  seems  not  to  be  directly 
Influenoed  by  instructional  conditions!  however,  in  curriculum  planning, 
education  should  be  ocnoemed  with  the  enhanoenant  of  all  kinds  of 
intelligences  while  prescribing  instructicn  that  ijqprnves  both  the  acguisltlon 
of  knowledge  and  the  developoent  of  thinking  strategies  in  probleni  solving  and 
creativity. 

next  I  sumnarize  hew  the  cognitive  con|>le)dty  processes  of  differentiation 
anl  integraticn  fan  conditions  for  thinking  strategies.  Within  this  sunnary, 
I  will  indicate  how  criteria  and  Intelligenoe  Interact  with  the  various 
conditions. 

Oonditlcna  In  the  DBveloaaaBnt  of  Ihinkina  Stratecdes 

Thinking  strategies  represent  a  oontinum  of  conditions  ranging  from  a  low^ 
order  of  automatic  recall  of  esdsting  knowledge  to  a  hlg|h-onler  of  creative 
thought  (see  Figure  2) .   In  TeiULe  1,  I  sunnarize  the  three  oonlltions 
associated  with  thixddng  strategies  (i.e.,  recall,  problem  solving,  and 
creativity)  by  their  rmpectivm  easploynent  of  the  cognitive  processes  of 
differentiation,  integration,  and  creation  of  knowledge.   Ihe  conditions  are 
further  categrjrized  by  identifying  situational  characteristics  and  thair 
reepective  criteria. 


Ihsert  TBible  1  about  here 


Recall,   The  first  thinking  strategy,  recall,  represents  the  retrieval  of 
knowledge  ftom  meaaoDry  as  it  e3d8ts.  This  first  condition  is  the  xnost  basic  and 
aixtoDnatic  form  of  knowledge  eaoployiDent  for  the  purpoee  of  serving  presdously 
enrxuntered  situations.  Situations  represent  problens  that  were  either 
loamed  concurrently  with  the  information  or  gained  later  throu^  eacpeacienoe. 

Recall  strategies  involve  an  automatic  dlf ferentiaticn  of  knowlege  from 
the  existing  knowledge  L<u9e.   The  criteria  for  dlff&rentiatlcn  is  an  Integral 
part  of  the  contextual  knowledge.   For  exnple,  when  a  susician  is  asked  to 
perform  a  familiar  piece  of  music,  tiie  existing  schema  is  retrieved  from  long^ 
term  memory  and  executed  without  modification.   The  cognitive  process  involved 
is  the  differentiation  of  the  appropriate  echema  ftom  others  organized  in  the 
knowledge  base. 

A  hi^ier-order  recall  B*-rategy  is  eoqployed  when  more  ocnplex  situations  in 
which  new  conditions  that  have  not  been  previously  encountered  are  part  of  the 
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Table  1 

Ihihking  Strategies:   Pecall,  Prtblan  ScOving,  and  Creativity 


Situation 


OonditiGns 


Criteria 


Racall 


Rmdously 
enoountered 


Differentiate  frcm 
existing  schemata 


Part  of 
schenata 


Previously 

enoounteracV 
nm  conditions 


Differentiate  and 
integrate  fton 
existing  schasData 


Part  of 
schemata 


^xbleDii  Solving 


n»viou8ly 
unenoountered 


Previously 
unenoounterad 


Differentiate  and 
integrate  to  form 
nev  schma 

Craate  knoirledge, 
differentiate,  and 
integrate  to  f ooi 
na#  schena 


Part  of 
schemata 


Develop 
criteria 


Creativity 


Create 


Cnaate 


Differentiate  and 
integrate  to  f  cm 
rmi  schema 

Create  knowledge, 
differentiate,  and 
Integrate  to  f om 
nsv  schema 


Peu±  of 
schemata 


Develop 
nevr 

criteria 
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problem.   Ihis  cxsgnitive  process  is  still  autcnatic  for  differentiation  hut 
given  the  new  ocnditions,  integration  of  knowledge  frcn  existing  schemata  must 
be  dene.   This  is  the  condition  of  cognitive  processing  that  nest  es^ierts 
operate  at  because  of  the  sc|)histicaticn  of  their  knowledne  base  gained  fZon 
e}43erienoes.  Again,  the  criteria  for  differentiation  is  part  of  the  existing 
contextual  knowledge. 

For  exaaple,         a  musician  is  aftked  to  perform  a  familiar  piece  of  music 
vmder  altered  conditions  (e.g. ,  in  a  new  key  or  a  new  arrangement) 
differentiation  is  not  the  only  cognitive  process  needed.   While  the  schema 
for  the  nusic  is  retsdeved,  the  musician  must  also  retrieve  existing  schema 
that  deal  with  the  new  conditions  (e.g.,  how  to  tran^nse  ttm  one  key  to 
another) .   Hob  integration  of  all  i^iExrcpriate  schemata  is  required  to  succeed 
at  the  task. 

PttJblam  solving.   Ihis  condition  is  primarily  associated  with  situations 
dealing  with  previously  unsnoountered  problems.   That  is,  the  term  ec^^ 
solving  is  most  often  defined  for  situations  that  require  eooploying  knowledge 
in  the  service  of  problems  not  alreac^  in  storage,    m  these  types  of 
situations,  the  thinking  strategies  require  the  integration  of  knowledge  to 
foot  new  schema. 

A  first  condition  of  problem  solving  Involves  the  dif fermitiation  process 
of  selecting  knowledge  that  is  currently  in  storage  using  kncwn  criteria. 
Concurrently,  the  selected  knowledge  is  integrated  to  form  a  new  schema. 
Cognitive  ocnplexity  within  this  condition  focuses  on  elaborating  the  existing 
knowledge  base.   For  exanple,  «hen  learning  an  entirely  new  piece  of  music,  a 
musician  must  create  a  new  schema  for  the  maic  in  the  retrieval  system  of 
long-term  memory.   Ihis  is  aoocnpliehed  by  differentiating  the  kncwn  elements 
of  all  music  that  exist  in  the  piece,  and  integrating  them  with  new  connections 
into  a  representation  of  the  xjnfamiliar  music.   The  new  schema  then  becomes 
part  of  the  knowledge  base. 

In  contrast  to  the  above  problem  situation,  are  those  in  vftiich  the  current 
knowledge  base  is  insufficient,  requiring  therefore  the  creation  of  kncwledge 
by  enploying  the  entire  cognitive  i^stem  (see  Figure  1) .   That  is,  given  that 
the  necessary  knowledge  to  solve  the  problem  is  not  in  memory,  new  kncwledge 
must  be  created  by:  (a)  the  internal  processes  of  extending,  elaborating, 
transferring,  and  faming  new  linkages;  (b)  the  external  process  of  acquiring 
information;  or  (c)  a  oontoination  of  the  two.   Gcncurrently,  new  criteria  for 
the  differentiation  process  must  be  developed.   Obviously,  with  this  condition, 
Kahlberg's  first  postoonventional  level  would  be  most  preferred  for  criteria 
developnant  because  of  the  conoem  for  values  with  a  social  contract 
orientation.   It  is  also  at  this  stage  that  the  Gardner's  kinds  of 
intelligences  become  Isportant  factors  In  solving  the  problem.   Ohus,  the 
sophistication  of  a  prc^xased  solution  is  a  factor  of  the  person's  knowledge 
base,  level  of  cognitive  coBplexity,  higher-order  thinking  strategies,  and 
intelligence. 
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For  exaaple,  If  a  highly  trained  classical  nuslcian  is  asked  to  perfom 
jazs,  It  nay  ragoixs  ths  caeatiai  of  naw  knowledge  about  jazz  idicns.  This 
WW  knowledgre  aay  be  dsveloped  either  by  the  internal  three-way  interaction  of 
the  ousician's  cognitive  ocnplcodty,  higher-order  thinking  strategies,  and 
auslcal  intelllganoe  or  by  ocnbining  the  three  with  external  inf armation 
aourois  (e.g. ,  an  ea^wrt  in  jazz) .   It  will  also  require  the  developjaent  of  new 
criteria  for  dstemining  the  quality  of  the  perfonnancae  based  an  criteria  held 
by  the  jazz  ccmunity. 

CteatlvLt^r.   The  highest  order  of  hunan  cognitive  processing  is  the 
creating  of  the  prioblen  situation.  Bather  than  having  the  external  environment 
dictate  the  situation,  the  indivitSual,  internally,  creates  the  need  or 
problen. 

Nittain  cne  condition,  the  individual  creates  new  situations  but  only 
%rlt3dn  hl^OMr  CMn  curxmt  knowledge  base.   Differentiation  is  done  within  the 
acfaemsta  and  criteria  available.   Scdution  to  the  situation  is  done  by 
integration  of  the  selected  knowledge  in  foming  a  new  schana. 

For  exaaple,  ooBpoeerB  often  have  a  recognizable  style  in  their  music 
even  though  individual  pieces  are  new  and  varied.   Biat  is,  utilizing  the 
existing  knowledge  base  they  cwete  new  nusic  judging  its  quality  against 
existing  criteria. 

Ihe  highest  cognitive  condition  exists  «hen  the  lxx3ividual  creates  not 
coily  the  situation,  but  also  the  new  knowledge  and  criteria  necessary  for 
a^ution.   Cheating  knowledge  invdves  the  entire  cognitive  syBtem.   Ihus,  in 
oonteast  to  xecall  thinking  strategies  ,  which  are  characterized  as  the 
autontic  fUnctioiing  of  the  cognitive  processes,  creativity  seeoe  to  involve 
both  the  oonKientiouB  deliberations  of  differentiation  and  integration  and 
the  qpontaneous  integrations  that  operate  at  a  neta-oognitlon  level  of 
awBrensas. 

  Jtar  exBsple,  by  developing  or  aoquiring  new  conposltional  techniques,  a 

t:rin»jeeL  say  nake  an  innovative  change  in  style.  That  change  nay  further 
reqjiire  the  developnent  of  new  criteria  corresponding  to  the  new  style. 
Differentiation  and  integration  using  the  new  criteria  allows  for  the  creation 
of  new  knowledge. 

In  the  next  section  Iwill  present  an  instructional  strategy  that  has  been 
eapiricBlly  tested  to  develop  and  inprove  hlgher^-order  thinking  processes 
(eqpedally  the  cognitive  processes  of  differentiation  and  integration) .  ihls 
%«rk  has  bean  done  within  a  program  of  nenoHirh  associated  with  the  Minnesota 
Adaptive  instructional  Systen  (MAIS;  Tennyson  &  Rak,  1987) . 

Ocnrlex  Problen  Siinulations 

SlmOation  in  educational  ocn|3Utlng  is  a  widely  enployed  technique  to 
teach  certain  types  of  ooBC>lex  tasks  (Breuer  &  Hajovy,  1987) .   ihe  purpose  for 
using  slaulations  is  to  teach  a  task  as  a  oonplete  whole  instead  of  in 
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successive  parts.   For  exaaple,  sixDulatlcns  axe  used  in  aviation  training  to 
r^lcate  the  ocnplex  Interactlcn  of  a  nuniaer  of  variables  needed  to 
suooessfully  pilot  an  airplane.   learning  the  numercus  variables  sisultaneously 
is  neoessary  to  fully  understand  tiie  vftiole  ccnoept  of  flying.   I  define  these 
types  of  sinulatlons  as  pccblegat-orlented  because  the  educatlcnal  objective  is 
to  learn  the  variables  (i.e. ,  declarative  and  procedural  kncwledge)  and  their 
context  (i.e.,  contextual  knowledge). 

Huwever,  nr/  concern  in  this  p!«>er  is  not  with  the  aogulsltlon  of  kncwledge 
but  the  employment  of  knowledge  in  tiie  service  of  prcblan  solving.   Thus,  I  am 
most  conoemed  with  siaulatiora  that  will  help  students  iooprove  their  cognitive 
ocnplexity  in  problen  solving;  that  is,  cognitive  processes  associated  with 
the  retrieval  system  of  menory  rattier  than  the  storage  systen  (see  Figure  2) . 
fttiereas,  probleni-oriented  siaulatiora  may  infirove  the  latter,  oovplex  BSESblsn 
simulettlom  focus  on  the  iapFovement  of  the  focmer.  Ihe  assunptlon  in  ocnc>lex 
problem  simalatlora  is  that  the  student  has  aoqcdred  sufficient  knowledge  to 
proceed  in  the  developgaent  of  thinking  strategies  enploylng  the  ccgnitlve 
processes  of  dlffererxtiatlon  and  integration  (and,  perhaps  in  creating 
knowledge) . 

Because  I  am  interested  fran  an  educational  pePEpectlve  in  both  the 
acquisition  of  knowledge  and  the  iirprovement  of  cognitive  abilities  for  prcblem 
solving,  I  have  egproached  the  design  of  an  instructional  strategy  for 
enhancing  hl^her<arder  thinking  strategies  davelopDoent  frcm  a  total  curricular 
and  instructional  system  (Seidel  &  Stolurow,  1980) .   Ohat  is,  instead  of 
viewing  the  learning  of  hic(her^-order  thinking  strategies  as  being  independent 
fran  other  condltlora  of  learning,  I  have  made  it  an  integral  cunxjuait  of  the 
Minnesota  Adaptive  Instructional  Syaten  (MAIS) .  As  with  the  other 
instructional  variables  and  condltlora  of  the  MAIS,  the  conplex  problem 
simulation  technigLie  piooonted  here  can  be  applied  in  other  instructional 
systems  other  than  the  MAIS.   To  Illustrate  Vt»  relatlonahip  of  higher^'^Eder 
thinking  strategies  to  knowledge  aogulsltlon,  I  will  briefly  review  the  MAIS. 

MAIS  environment.   The  MAIS  is  basically  a  coBi3Uter^4)ased  research  tool 
in  which  we  have  investigated  Instructional  variables  associated  with  iaproving 
learning  according  to  individual  dlfferenoes  and  needs.  As  such,  the 
instructional  variables  are  represented  in  ade^ve  instructional  strategies 
that  in  turn  are  monitored  for  each  student  by  a  exgext  tutor  system  using 
artificial  intelllgenoe  techniques  (Tenryscn,,  1987) .   Figure  3  Illustrates  the 
main  ocnponents  of  the  MAIS. 


Insert  Figure  3  about  here 


Briefly,  the  MAIS  coraists  of  two  main  conporants:  (a)  a  currlculvmi 
ccnponent  (or  Macro) ,  which  ;inaintedra  a  student  model  (i.e. ,  the  cognitive, 
affective,  and  memocy  modelis*  of  each  student)  and  a  curricular  level  knowledge 
base.   An  eo^tert  tutbir  system  manages  the  Macro  to  maintain  the  student  model 
and  to  select  the  expropriate  information  to  be  learned;  and  (b)  an 
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Diagram  off  the  MAIS  Environment. 
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Instzuctioral  oaapcnex±  (or  Micro)  that  ddas/ta  the  ixistnctlGnsa  strategies 
aoooKdlng  to  mcmsnt-to^naoDant  learning  pocogress  and  need. 

Ihe  Hicro  is  likewise  managed  by  an  eoqpBrt  tutor  system  that  scnitors  each 
student's  given  learning  need.   The  instzuctional  strategies  for  the  Micro  are 
ocnpiled  based  cn  tte  data  ftOD  the  Jbaco.  As  the  student  progresses  throuc^ 
a  given  curriculum,  the  Mbcto  data  base  is  iteratively  x^dated,  lAiich  isfxroves 
the  refinenent  of  the  expert  tutor  decision  making  within  each  ocnponent. 

The  instructional  strategies  are  ccanpiled  using  Gagne's  (1985)  ttoee 
oonditionB  of  learning:  verbal  information,  intellectULil  akllls,  and  cognitive 
strategies.  Ihe  first  tuo  ocnditions  represent  the  acqLiisition  of  knowledge 
(i.e. ,  the  storage  system)  lAlle  the  third  is  associated  with  the  learning  of 
higherHorder  tiilhking  strategies.   Tenrr/ean  and  Chrlstensen  (1988)  present  the 
instructional  methods  for  acqLdsition  of  intellectual  skills  (i.e.,  the 
learning  of  declarative,  procedural,  and  contextual  knowledge) ,  while  in  this 
paper  I  present  the  instructional  strategy  for  the  cognitive  strategies 
condition  of  learning. 

!Ihe  goal  of  our  research  in  the  area  of  hlglher-order  thinking  strategies 
is  to  investigate  instructional  variables  that  iocsrove  student  enaj^oyment  of 
the  cognitive  processes  of  differentiation  and  integration.   To  acconpli^ 
this  go;d,  we  have  tested  instructional  methods  that  have  the  following  kinds 
of  characteristics: 

-Situations  that  themselves  have  a  meaningful  context  (i.e.,  not  a  game) 
that  require  the  students  to  use  their  own  knowledge  base; 

-Ccnplex  situations  to  challenge  the  differentiation  process; 

-EbqxDses  students  to  alternative  solutions  to  improve  their  integration 
process; 

-Students  see  challenging  alternatives  within  each  student's  own  level  of 
cognitive  oorqplexity; 

-Environmentally  meaningful  situations  to  develop  valvies; 

-Situations  that  use  reflective  evaluation  rather  than  right  or  wrong 
answers  to  develop  hlglherKarder  criteria; 

-Situations  that  allow  students  to  see  consegujnces  of  their  solutions 
and  decisions; 

-Situations  that  allow  for  predicting  value  of  future  states; 

-Situations  that  allow  for  continuous  develofineiTt  of  hic|her^order 
thinking  strategies. 
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WHJrn  cxxiventional  oonfutezHaased  sisulatlons,  oaoplex  problan 
siiulatlona  do  not  naoauarlly  enploy  the  ocaiMter  as  the  Instmcticnal 
doliveEy  systan.   Hha  main  putpose  of  the  oonijuter  In  our  design  strategy  is 
to  aanage  (and,  in  the  MAIS  environnant,  to  mcnitor)  the  similation  with  the 
f5?**  ^InSMBOBt  of  th»  leandng  activities  with  resources  other  than  the 
ocaiufcar.  Dqpmling  on  tha  laaming  situation,  the  ocnputer  oould  certainly 

UMd  as  a  laazning  and  iMtruc±ic-«l  resource.   Far  eoaa^,  In  flight 
ttaining^tiia  flic^  siulator  oould  ba  used  for  the  JjtptDvonent  of  trainee 
U^Mr-cvter  thlridng  stiategias  fttUowincr  the  design  variables  def inpi  below. 
Most  lijoaly,  this  taem  of  learning  higher-order  thihking  strategies  as 
contrasted  to  nffljiisition  of  Imowledge  would  be  a  more  effective  use  of  flight 
slaulatars. 

^  oonditlais  of  ooncilex  problem  simulations  are  grouped  untSer 

three  oaln  ooniionents:  necessary  knowledge,  simulation,  and  learning 

.^^SflB^J  ^^^^^^^^^^^^^^^  ' 

cnvmnoBnc* 

WenassaTV  knowledaa.  An  laportant  ai^iect  In  developing  and  isprcving 
m^^in'^Kdar  tiiiridng  strategies  is  to  mate  sure  that  the  students  have  the 
neoassary  kncwledga  base  to  begin  the  ccn|>lex  prcblen  simulation.  Ntoessary 
knowledge  indudas  tha  specific  donain's  declarative,  procedural,  and 
oont«*ual  kncwladga.  mat  is,  it  is  within  the  student's  own  knowledge  base 
will  perfdim  the  cognitive  processes  of  differentiation  and 
intagratioi.  Without  tha  donain's  necessary  knowledge  as  prerequisite,  the 
student  will  not  be  able  to  fully  develop  anVor  laisicove  their  thinking 
steatagiee  because  there  is  no  knowledge  to  differentiate  and  integrate.  For 
exBBiae,  in  a  q^staa  like  lOGO  «hich  doss  not  have  a  epecificaUy  defined 
dcnain  of  knowledge,  students  always  cone  vp  with  the  eame  finite  set  of 
figures:  usually  coaling  frcn  associated  dcnains  of  knowledge. 

fiJailoLLflD*   Ihls  design  variable  coraists  of  two  parts.  Ohe  first 
•stdbliihss  the  problMi  situation  while  the  second  is  the  oonputer  management 
syst«B.   Ohe  proiaiaB  situation  should  Inclide  the  characteristics  listed 
Jbove.   Ih  addition  to  those,  the  simulation  should  be  longitudinal,  allowing 
for  increasing  difficulty  of  the  situation  as  well  as  providing  the  adding  and 
dro^ug  of  variables  and  conditions,   m  more  eophisticated  simulations  these 
alterations  and  changes  ehould  be  done  according  to  individual  differences. 
Also,  the  kinds  of  InteUin-moes  should  be  ooMidtzed  within  the  curriculum 
plans. 

Ihe  main  fUnctlxais  of  the  concutar-based  management  part  of  the  simulation 
are:  (a)  to  ponsent  the  initial  oonditiora  of  the  situation;  (b)  to  assess  the 
studmt'e  ptoposad  solution;  and  (c)  to  establish  the  next  iteration  of  the 
conditions  baaed  on  tha  cuwlative  efforts  of  tha  student. 

Timing  WylrBtlMPfc.  to  further  enhance  the  developgunt  and  liiprovanent 
of  higher-order  thinking  strategies,  I  am  proposing  the  enplqyment  of 
cooperative  learning  mrthods.   current  research  findings  on  cocperative 
learning  Indicate  significant  iaprovement  in  the  learning  of  Information 
(i.e. ,  storage  systan)  whan  intra-group  maaters  help  each  other  in  goal 
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at±aiiiment  (for  a  cxnplete  revdev  see  JGhnson  &  Johnscn,  1987)  •   Our  own  loost 
recent  research  (Breuer,  1985,  1987)  shows  oooperatlve  learning  mettods  as 
ispxving  problem  solving  strategies. 

Hie  researdi  findings  indicate  that  intra-grocp  interactions  in  prdblesor 
solving  situations  cGntribute  to  cognitive  ocnplexi^  develcpntt  because  the 
students  are  cGnfctnted  with  the  different  intaspretaticns  of  the  given 
simulation  conditions  by  the  ottier  group  SMters.   In  thia  way  new  integrations 
between  existing  ccncepts  vltliin  and  between  echenata  can  be  established, 
alternative  integrations  to  a  given  situation  can  be  detected,  and  criteria 
for  jtdging  their  validity  can  be  develqped. 

An  iiqpoirtant  issue  in  coqperative  learning  is  the  procedure  used  to  groip 
students.   Most  often,  Jdben  cooperative  learning  groups  are  used  for  knowledge 
aocpairsition,  the  students  are  organized  according  to  heterogeneous  variables, 
such  as  gender,  socio-econcnlc,  intelligenoe  and  achievenent.   However,  cur 
research  shoMS  that  fbr  dsvelopnent  of  thiiildng  strategies,  group  neniserBhip 
Should  be  on  siadlarlt/  of  abiiity  in  cogpiitive  conpleKlty.   lhat  is,  within 
groups,  students  should  be  confronted  with  solution  proposals  that  are  neither 
too  such  above  or  below  theix  own  levels  of  conplexity. 

For  exanple,  students  with  low  cognitive  conplexlty  become  frustrated  and 
confused  with  hi^y  sophisticated  solutions,  while  students  with  hig(h 
cognitive  coBoplexity  are  not  only  not  challenged  but  beoome  goickly  bored  with 
less  sophisticated  solutions. 

HbB  fbrxnat  of  the  group  activity  should  enoploy  a  oontroverey  nethod  vAiere 
a  consensus  is  reached  foUcwing  a  discussion  of  proposals  independently 
developed  and  advocated  by  each  mnfaer.  Ihis  fbnnat  is  in  contrast  to  the 
oopplianoe  method  where  a  consensus  is  reached  hy  neaDbers  working  together 
froa  the  start. 

The  controversy  nethod  can  be  e}q>lained  in  the  following  st^: 

1.  The  problem  situation  is  presented  to  the  students.   The  cooputer^ 
based  siinulaticn  prints  out  the  initial  conditions  of  the  situation. 

2.  The  students  on  an  individual  basis  study  the  situation  and  prepare 
an  independent:  proposal. 

3.  The  students  reaBsenoble  as  a  group  to  present  their  proposals.  In 
the  initial  presentation,  the  students  are  to  advocate  their 
position. 

4.  Following  the  initial  presentations,  the  students  are  to  continue 
advocacy  ot  their  proposals  in  a  debate  fiiehion.   The  concept  of  the 
oontroversy  netiiod  is  used  to  help  the  students  further  elaborate 
their  positions  as  well  as  seeing  possible  extensions  and 
alternations. 

5.  The  final  goal  of  the  group  session  is  to  prepare  a  cooperatJ.ve 
proposal  to  input  into  the  simulation.  This  consensus  is  reached 
only  after  a  conplete  debate  and  should  represent  the  grocp's  ^^best" 
solution. 
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6.    Hie  ocn{uter  pcogram  wiU  then  nxSate  the  situation  aooordlng  to  the 
varices  and  oonditicns  of  the  sdnulaticn.  The  steps  are  then 
z«paated  until  the  ocn(>letiGn  of  simlaticn. 

m  namary,  ocB|kIeK  pccblen  sioulaticns  are  designed  to  provide  a 
learning  envircpnenb  in  which  students  develop  and  iaprove  higher^-order 
thinking  strategies  b/  engaging  in  situations  that  require  the  enplqyment  of 
their  Icncwled^e  base  in  the  service  of  prcblen  solving,    m  the  final  section 
I  present  eaeBigples  of  several  of  the  sinulations  developed  for  our  research 
and  later  converted  to  software  products. 

Sofbuare  Exanples 

CcapleK  pccblen  sinulations  *toich  ware  developed  in  Germany  and  the 
Uhitad  States  include  the  follawlng: 

-Oie  eoononic  system  of  a  auniclpality  which  is  to  be  iaproved  by  the 
"tom  council." 

-Tlie  ■ifizoaoononic  system  of  a  coapany  ^*ich  is  to  be  run  by  a  "toager." 
-Ohe  flood  ocntrbl-system  within  a  county  which  is  to  be  ccerated  by  an 
"eaflKsitlvB." 

living  conditions  of  an  Aftlcan  tribe  ^ch  should  be  inprcved  by  an 
"adviflor.**  * 
•^Sie  efficiency  of  fuel  and  energy  consunption  to  meet  modem-day  needs. 

m  each  of  these  situations,  a  set  of  materials  were  prqared  in  which 
the  necessary  Jouwledge  was  presented.  Ohe  students  were  taught  the 
infoowtion  by  both  teacher  presentations  and  print  materials.   After  all 
students  had  learned  the  necessary  knowledge  they  were  assigned  to  a  graxp 
based  on  similarity  of  cognitive  ocnplexLty. 

Each  of  the  sinulations  imnmamiluJ  dynamic  situations,   lhat  is,  they 
depicted  situations  that,  without  action  fixa  the  decision-makers,  would 
or>1  lapse  after  a  certain  time  period.   Fbr  exanple,  the  tribe  vanishes  because 
of  starvation,  nm  conpany  goes  into  the  red,  and  so  forth.   Each  of  the 
sinolations  stressed  the  need  for  decision-making  and  the  proposals  required 
solutions  that  included  cognitive  conflicts. 

Ihe  sJmlations  were  conplex  and  longitudinal  so  that  after  each  period 
of  dKdsioninaklng,  the  new  status  of  the  situation  was  reported  to  the 
etudenbi.   Ihis  allcued  the  students  to  test  the  adequacy  of  ttieir  most 
current  conceptualizations  of  the  situation  with  the  v^xiated  conditions,  and 
usually  rawjlted  in  the  need  for  revisions,   m  addition,  because  of  the  open 
definitions  of  the  situations  in  tenns  of  global  goals,  the  level  of  thiridng 
remained  hi^,  preventing  the  mere  recall  of  information. 

In  manary,  the  ccnpleK  problem  siiailations  iihich  we  have  developed  have 
^io*"  significant  iiipraveuents  in  the  develoEuent  of  higha^-order  thinking 
strategies,   lhat  is,  there  were  measurable  increases  in  the  cognitive 
of  differentiation  and  Integration. 
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Conclusion 

ThB  learning  princdple  underlining  cur  research  peogram  is  that  thinking 
strategies  are  aoquired  in  reference  to  eDDplcvnnxt  of  the  learner's  own 
knovledge  base  and  ^t  they  are  not  independent  thinking  Edcills.  Oir 
instnx±ional  prlnd^e  is  that,  because  cognitive  ccnixLexity  is  an  ability, 
it  can  be  developed  and  iaproved  with  Instructional  intervention.  Iherefoie, 
the  goal  of  our  research  pcoaram  is  to  stud/  instructional  variables  within  the 
context  of  an  instruntlonal  sysben  that  takes  into  account  both  the  storage 
and  retrieval  systems  of  loncrterm  aenacy.  Ihe  WIS  environnent  poxvides  this 
opportunity  because  of  direct  concern  fbr  both  curriculum  and  instruction  and 
for  all  conditions  of  learning. 

As  this  pBpuc  indicates,  ocnplex  problen  similations  focus  on  tlie 
iapcDvenent  and  develcpnent  of  hlgfhsr^^cder  tdilriking  strategies  (i.e. ,  probleni 
solving  within  the  context  of  cn|>loying  the  knowledge  base) .  We  are  continuing 
research  at  this  level  while  future  efforts  will  also  Include  direct 
investlgatiora  at  the  creativity  level.  Wa  anticipate  that  learning  activities 
at  that  highest  level  will  be  nore  directed  towards  Incxeased  individual 
efforts  with  groip  activities  geared  more  at  critical  analysis  than  consensus. 

The  Influence  of  intelligenoe  in  the  entire  process  of  higher-order 
thinking  is  another  problfln  area  fbr  our  future  research.  We  anticipate  a 
higlh  oorrelatlcn  between  cognitive  Ability  and  intelligenoe,  but  perhaps  will 
see  other  variables  Interacting  in  the  cocpiitdve  process:  such  as  criteria  and 
values  dsvelopnant  and  achievenent  motivation.   Bsycholcgist  have  long 
recognized  that  hi^(her-order  thinking  strategies  involve  more  than  just 
acquisition  of  cognitive  skills,  but  other  variables  and  conditions  of  the 
total  human  system. 
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Conventional  Intelligent  computer-assisted  Instructional 
systems  (ICAI)  have  a  theoretical  foundation  which  Is  based  In 
computer  scler^ce  (Dreyfus  &  Dreyfus,  1986).    Current  ICAI 
programs  are  basically  prototype  systems  whose  aim  Is  to  enhance 
Instruction  through  the  employment  of  computer-based  software 
tools.    Most  of  these  tools  are  directly  associated  with  the 
expert  systems  methods  of  the  artificial  Intelligence  (AI)  field. 
Given  the  computer  science  focus  of  these  conventional  ICAI 
programs,  the  attention  given  to  learning  and  Instructional 
theories  has  been  minimal.    As  such,  there  Is  no  direct  empirical 
verification  to  show  how  the  specific  software  tools  may  result 
In  Improved  learning.    The  assumption  of  the  conventional  ICAI 
proponents  Is  that  the  tools  themselves  will  Improve  learning. 
However,  learning  and  Instruction  are  much  more  complex  processes 
than  are  exhibited  In  the  prototype  ICAI  systems  and,  when  viewed 
from  an  educational  perspective,  these  systems  have  a  rather 
novice  approach  to  both  learning  and  Instruction  (Tennyson  & 
Park,  1987). 

With  this  perspective  In  mind,  we  would  like  to  suggest  that 
the  next  generation  of  ICAI  will  differ  from  the  current  software 
tool-based  models,  to  Instructional  systems  that  have  their 
theoretical  foundations  In  educational  and  psychological  theories 
of  learning  and  Instruction.    The  aim  of  the  educational ly-based 
ICAI  systems  will  be  to  Improve  the  acquisition,  storage,  and 
connections  between  Instructional  variables  and  learning.  The 
next  generation  ICAI  systems  will  employ  the  Al/expert  systems 
tools  but  with  variables  and  conditions  directly  related  to  the 
fields  of  psychology  and  education.    This  paper  will  define  the 
next  generation  of  ICAI  by  showing  the  elaborations  and 
extensions  offered  by  educational  research  and  theory 
perspectives  to  enhance  the  ICAI  environment. 

Conventional  ICAI 

Conventional  ICAI  systems,  using  expert  systems  methods, 
have  three  major  modules  (or  models)  (Fletcher,  1984);  a 
knowledge  base,  a  student  model,  and  a  tutor  model.    Each  of 
these  modules  can  be  summarized  as  follows  (Figure  1): 

-Knowledge  base.    A  data  base  which  represents  knowledge 
of  a  specific  topic  that  an  expert  may  have  In  memory.  The 
Information  In  a  knowledge  base  Is  usually  obtained  by  an 
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lnt«rvl«v  conducted  between  an  Individual  labelled  as  a 
knowledge  engineer  and  a  subject  matter  expert.  The  goal 
of  this  process  is  to  query  the  expert  so  as  to  obtain  both 
declarative  knowledge  and  procedural  knowledge.  The  idea 
is  to  have  a  knowledge  base  module  that  can  both  generate 
solutions  to  previously  unencoxintered  situations  and  make 
inferences  from  incomplete  measures  or  data. 

-Student  Model*  A  mechanism  for  assessing  the  student's 
current  Jcnowledge  state  of  the  information  in  the  knowledge 
base.  The  student's  prior  knowledge  state  is  generally 
represented  as  either  a  subset  of  an  expert's  knov;ledge 
(e.g.,  overlay  model,  Goldstein,  1982)  or  the  student's 
misconceptions  of  the  expert's  knowledge  base  (e.g.,  the 
buggy  model.  Brown  &  Burton,  1978). 

Tutor  Model.    The  purpose  of  this  module  is  to  manage  the 
instruction.    This  is  done  by  a  management  system  (termed  an 
inference  engine)  that  makes  decisions  such  as  selecting 
problems  to  be  solved,  critiquing  performances,  providing 
assistance  upon  request,  and  selecting  remedial  materials. 

In  conventional  form,  the  tutor  model  employs  basically  a 
single  instructional  strategy  embedded  in  the  system  for  all 
students  and  situations.    For  example,  the  most  commonly  used 
strategy  is  a  Socratic  method  of  teaching  which  requires  the 
student  to  response  to  a  given  stimulus.    As  such,  the  strategy 
borrows  heavily  from  the  early  programmed  instruction  (PI)  format 
of  intrinsic  programming  developed  by  Crowder  in  the  late  1950s. 


Insert  Figure  1  about  here 


Educational  Research  and  Theory  Perspectives 

Because  of  the  powerful  programming  tools  offered  by  the 
developments  in  AI  software  Intelligence  methods,  we  feel  that 
computers  can  now  offer  educators  a  means  to  more  fully  utilize 
the  capabilities  of  the  computer  to  enhance  instruction  and, 
thus,  improve  learning.    To  fully  accomplish  this  goal,  the  AX 
tools  need  to  i^e  employed  within  the  conditions  of  the 
educational  environment.    Proposed  for  the  next  generation  of 
ICAI,  is  a  system  that  elaborates  and  extends  the  three  basic 
modules  of  the  conventional  iCAI  system  (see  Figure  1) .  The 
proposed  additions  are  taken  directly  from  a  rich  base  of 
cognitive  psychological  and  educational  theory  and  research  on 
learning  and  instruction.    The  educational  perspective 
offers  ICAI,  in  contrast  to  the  contemporary  computer  science 


ERIC 


618 


Conventional 
ICAI 

Components 


Educational 
Elaborations 


•  Developmental 
Knowledge 

•  Different 
Perspectives 

•  Creative 
Search 
Strategies 


*  Informal 
Heuristics 

*  Meta-Learning 
Theory 

*  Meta-lnstructlonal 
Strategies 


•  Individual 
Differences 

*  Necessary 
Knowledge 

Prerequisite 

Associative 

Background 


Elaborations  to  ICAI  from  an  Educational  Perspective. 

sa^Elabonrtbns  0 1986,  Ttnnyson  ft  AssodatM  V 

ERIC  607 


Educational 


4 

perspective  with  its  limited  and  narrow  understanding  of  learning 
and  instruction,  an  integration  of  AI  tools  and  methods  with 
instructional  variables  and  conditions  empirically  tested  and 
shown  to  improve  learning.    The  basic  educational  elaborations 
and  extensions  can  be  summarized  as  follows  (see  Figure  1) : 

-To  extend  the  knowledge  base  to  include,  in  addition  to  the 
expeirt's  knowledge,  developmental  knowledge  used  by  the 
learner  to  acquire  expert  knowledge  (i.e.,  Dreyfus  &  Dreyfus, 
1986) . 

-Develop  knowle(?.ge  bases  in  ways  that  represent  different 
perspectives  on  problem  solving  and  problem  formation. 

-Employ  inference  engines  within  tutor  models  that  use 
informal  and  fuzzy  logic  methods  in  addition  to  the 
structured  formality  offered  by  the  current  methods  of  IF 
THEN  rule  statements.    This  would  allow  for  much  broader 
applications  of  ICAI  in  less  structured  domains  of 
information  (e.g.,  the  humanities) . 

-Extend  the  forms  of  knowledge  representation  to  include, 
in  addition  to  the  usual  tree  structures,  heuristic  systems 
that  create  search  strategies. 

-Design  tutor  models  that  more  fully  exhibit  the 
characteristics  of  an  expert  teacher  by  increasing  the 
potential  of  the  instructional  strategy.    That  is,  a  tutor 
model  th&t  prescribes,  instead  of  a  given  single  strategy, 
a  meta-ins'iructional  strategy  formed  from  a  rich  pool  of 
instructional  variables. 

-Expand  the  student  diagnosis  to  include  individual 
differences.    Rather  than  the  simple  assessment  of  prior 
knowledge  to  prescribe  instruction,  additionally  evaluate 
students  in  reference  to  cognitive  and  affective  variables. 

-Elaborate  the  student  model  by  assessing  in  addition  to 
prior  knowledge  other  forms  of  necessary  knowledge.  These 
other  forms  include:  (a)  prerequisite  knowledge,  information 
directly  needed  to  understand  the  information  to  be  learned; 
(b)  associative  knowledge,  information  within  the  domain 
being  learned  but  not  directly  connected  or  linked  to  the 
information  being  learned;  and  (c)  iaackground  knowledge, 
information  that  provides  a  context  to  fully  understanding 
the  inforaation  to  be  learned. 

In  planning  a  learning  environment,  it  is  convenient  to 
consider  the  division  of  the  educational  variables  and  conditions 
intu  curricular  and  instructional  components  (Tennyson  & 
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Christensen,  1988) •    The  curricular  component  includes  those 
elements  of  education  not  directly  linked  to  student  interaction. 
The  instructional  component  on  the  other  hand  deals  with  those 
elements  directly  involved  with  student  interaction  in  learning. 
Using  this  paradigm,  we  will  discuss  the  above  defined  educational 
elaborations  for  ICAI  within  these  two  components.    Our  assumption 
is  thet  in  an  ICAI  environment,  these  two  components  would 
operate  in  an  iterative  fashion  such  that  the  conditions  of 
instruction  established  in  the  curricular  component  would  adjust 
according  to  learner  progress  and  needs  while  in  the 
instructional  component.    And  that  learner  outcomes  from  the 
instructional  component  would  feed  back  to  the  curricular 
component  to  update  the  decision  making  mechanism  at  that  macro 
level  (Seidel  &  Stolurow,  1980). 

Thus,  in  addition  to  the  above  defined  elaborations,  we 
propose  that  ICAI  be  extended  into  an  educationally-based 
learning  environment  that  includes  both  curricular  and 
instructional  variables  and  conditions.    Also,  that  the  ICAI 
sysrem  provide  for  adaptive  instruction  based  on  cummulative 
knowledge  and  moment-to-moment  learning  need.    Within  a 
curricular  component,  the  system  would  diagnose  the  student  from 
initial  assessment  information  and  then  from  continuous 
information  coming  back  from  the  instructional  component.  The 
curricular  component  would  prescribe  the  necessary  instruction 
from  normative  parameters,  while  with  the  instructional 
component,  the  system  would  adapt  the  prescription  according  to 
individual  student  needs  during  actual  learning.    In  this  sense, 
assessment  and  learning  would  be  occurring  simultaneously.  The 
next  two  sections  will  describe  my  proposed  extension  of  the 
current  ICAI  model  to  more  fully  meet  the  educational  situation 
as  contrasted  to  the  tool  design  paradigm  offered  by  conventional 
ICAI. 

Curricular  component.    The  primary  purpose  of  the 
curricular  component  would  be  to  establish  the  initial  conditions 
of  instruction  by  considering  the  interaction  of  individual 
difference  variables  with  the  specifications  of  the  content 
domain  of  a  given  curriculum.    Conventional  ICAI  has  no 
methodology  which  can  deal  with  the  considerable  effect  which 
individual  differences  have  on  learaing  achievement.  Tho 
curricular  component  would  encompass  both  the  cognitive  and 
affective  measures  of  individual  differences. 

Cognitive  measures  would  include  such  constructs  as 
intelligence,  aptitude,  ability,  and  cognitive  style.  For 
example,  a  learaer  may  have  a  high  intelligence  level  but  little 
aptitude  or  ability  for  a  given  curriculum.    Thus,  to  maximize 
learning,  instruction  should  be  adjusted  to  take  the  learner's 
strengths  and  weakneisss9  in  these  areas  into  account. 
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Affective  measures  would  deal  with  constructs  such  as  (a) 
personality  (e.g.,  Introverted  and  extroverted  learners  need 
different  optimal  learning  environments  [Eysenck  6  Eysenck, 
1975];  learners  with  a  Type  A  personality  tend  to  differ  In  drive 
from  Type  B  [Friedman  &  Kosenman,  1974]);  (b)  motivation  (a 
profile  of  the  learner's  Initial  motivation  can  be  adjusted  and 
have  Influence  as  the  learner  moves  through  the  curriculum 
[Tennyson  &  Breuer,  1984]);  and,  (c)  anxiety  (Instructional 
strategies  can  be  employed  to  lessen  anxiety  where  It  Interferes 
with  learning  [Tennyson  &  Boutwell,  1973]). 

In  conventional  ICAI  programs  the  student  model  Is  basically 
represented  as  a  subset  of  an  expert's  knowledge  base.  This 
error  model  focuses  on  the  student's  prior  knowledge  and  the 
ability  for  Information  recall,  while  Ignoring  the  acquisition  of 
the  information.    In  this  conventional  ICAI  model,  learners  can 
easily  form  misconceptions  (even  though  such  programs  are 
actually  trying  to  correct  misconceptions) ,  particularly  in 
higher  order  and  more  complex  information  structures  (Scandura, 
1984) • 

The  educational  perspective  offers  to  improve  on  this 
conventional  student  model  by  expanding  it  to  include,  in 
addition  to  prior  knowledge  assessment,  achievement  measures  on 
three  other  types  of  necessary  knowledge:  prerequisite, 
associative,  and  background  knowledge  (Tennyson  &  Cocchiarella, 
1986) .    Prerequisite  knowledge  refers  to  supportive  knowledge 
that  is  (a)  directly  related  to  the  information  to  be  learned  and 
(b)  the  student  already  has  in  memory.    Associative  knowledge 
refers  to  information  that  is  in  the  same  domain  but  is  only 
Indirectly  connected  with  the  to-be-learned  information. 
Background  knowledge  refers  to  information  that  is  generally 
outside  the  domain  but  provides  necessary  context  for  fully 
understanding  the  information  to  be  learned.    Prior  knowledge,  in 
contrast,  refers  to  that  specific  information  to  be  learned  that 
the  student  already  has  in  memory. 

The  addition  of  these  other  three  knowledge  achievement 
measures  would  influence  the  conditions  of  instruction  in  terms 
of  remediation  and  the  amount  of  instruction  for  the  to-be- 
Ir-med  information.    They  would  also  establish  a  richer  learner 
diagnostic  profile  for  instructional  prescriptions  than  one  based 
solely  on  a  single  variable  of  prior  knowledge  as  in  the  case  of 
conventional  ICAI. 

Each  of  the  above  mentioned  Individual  difference  variables 
has  differing  eff'-cts  on  learning  and  needs  constant  adjustment 
based  on  the  structure  of  the  to-be-leamed  information.    Wh  le 
each  of  these  constructs  has  implications  at  the  instructional 
level,  because  of  their  trait  nature,  putting  them  at  the 
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currlcular  level  can  definitely  expand  the  capabilities  of  the 
conventional  knowledge  base  (expert  module)  to  better  deal  with 
the  structural  conditions  of  the  information  to  be  learned,  in 
other  words,  curriculum  Issues  can  be  dealt  with  in  such  a  way 
that  if  learners  found  that  they  are  either  lacking  or  unsure  of 
specific  knowledge,  that  the  system  would  be  able  to  diagnose  the 
specific  knowledge  lack  and  to  appropriately  adjust  the 
curriculum. 

Instructional  component.    The  tutor  module  In  conventional 
ICAI  Is  basically  limited  to  one  instructional  strategy;  for 
example,  the  Socratic  and  coaching  methods.    With  only  one 
instructional  strategy,  the  system  can  run  into  a  number  of 
limitations  such  as:  assuming  too  much  or  too  little  student 
knowledge,  producing  instructional  material  at  the  wrong  level  of 
detail,  and  not  being  able  to  work  with  the  student's  own 
conceptualizations  of  the  information  which  they  are  learning. 

An  educationally-based  ICAI  system  would  expand  the  tutor 
module  by  not  limiting  itself  to  only  one  instructional  strategy. 
By  assessing  individual  difference  variables  and  currlcular 
issues  during  instruction,  the  system  can  have  the  flexibility  to 
prescribe  appropriate  integrated-instructional  strategies 
fTennyson,  1988). 

This  flexibility  would  be  allowed  by  the  use  of  informal 
heuristic  methods  in  the  inference  engine  of  the  tutor  model. 
The  use  of  these  heuristic  methods  is  built  around  a  direct 
connection  to  cognitive  science  theories  of  learning  (Ploya, 
1S45) .    A  heuristic  can  be  defined  as  a  "rule  of  thumb"  search 
strategy  that  is  composed  of  variables  that  can  be  manipulated  to 
provide  increasingly  better  decisions  as  more  knowledge  is 
acquired.    This  ability  allows  the  heuristics  to  adjust 
to  new  data  and  experiences  and  to  add  new  variables  and  even 
heuristics  without  necessarily  influencing  the  operations  of  the 
system. 

Frequently,  program  designers  refer  to  informal  heuristics 
as    fuzzy  "  logic  statements  because,  unlike  the  production  rule 
statements  needed  in  conventional  ICAI  programs  (i.e.,  IF  THEN 
statements) ,  infonnal  heuristics  can  be  written  as  abstract 
flexible  statements  which  acquire  assumptions  with  experience. 
Therefore,  an  Informal  heuristic  can  start  to  understand  a 
situation  and  "think**  about  possible  outcomes  that  do  not  exhibit 
correct  or  incorrect  solutions.    Also,  informal  heuristic  methods 
differ  dramatically  from  the  algorithm  or  tree-structure 
methodology  of  AI  programming  in  that  they  are  usually  written  as 
conditional  probability  statement  codes.    In  educational  terms, 
an  inforaal  heuristic  may  be  thought  of  as  a  higher  order  rule 
statement  rather  than  a  depository  of  domain-specific  information 
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We  propose  the  employment  of  the  informal  heuristic  approach 
because  the  flexibility  offered  by  such  programming  techniques 
allows  the  integration  of  various  theory-based  learning  variables 
to  a  given  programmatic  method  (e.g.,  few  learning  variables  fit 
a  tree-structure  format) .    These  heuristics  would  be  used  in  the 
sense  of  leading  to  discovery  by  considering  many  different 
learning  variables,  abstraction  levels  (shifts  from  one  level  to 
another),  and  unique  combination  which  establish  the  conditions 
for  learning  and  the  conditions  of  instruction. 

Selection  of  the  integrated- instructional  strategies  would  be 
based  upon  four  different  sources  of  information  (Tennyson  & 
Rasch,  1988) .    First,  the  direct  connection  to  a  learning  theory 
which  explains  learning,  memory,  and  cognition.    Typically,  from 
an  educational  perspective,  this  would  be  in  the  form  a  meta- 
learning  theory  developed  because  of  the  educational  need  to 
explain  both  learning  and  cognition.    Second,  an  understanding  of 
the  learning  outcomes  related  to  the  objectives  of  the  curriculum 
and  instruction.    Although,  there  are  many  taxonomies  by  which  to 
specify  learning  objectives,  we  employ  the  well-developed  approach 
offered  by  Gagne's  (1985)  conditions  of  learning  (verbal 
information,  intellectual  skills,  and  cognitive  strategies) . 
Third,  the  structure  of  the  information  to  be  learned  needs  to  be 
analyzed  for  both  learning  effectiveness  and  storage  in  the  data 
base.    Conventional  expert  system  tools  and  shells  provide 
assistance  in  the  latter  development  of  the  knowledge  base. 
However,  the  presentation  structure  needs  additional  manipulation 
to  improve  learning.    Much  of  the  recent  research  findings  in 
human  knowledge  representation  (as  constrasted  to  machine 
representation  as  in  Al/expert  systems  programs)  clearly 
indicates  that  the  overt  structure  of  the  information  directly 
f£  acquisition.    That  is,  presenting  the  information 

in  reference  to  its  schematic  structure  significantly  improves 
acquisition  because  the  learner  is  storing  both  semantic 
knowledge  and  schematic  knowledge  simultaneously,  conventional 
ICAI  knowledge  base  structures  are  only  focusing  on  semantic 
understanding.    And,  fourth,  the  instructional  variables  which 
can  be  prescribed  into  specific  and  adaptable  integrated- 
instructional  strategies.    Most  of  these  instructional  variables 
are  derived  directly  from  educational  research  findings.  For 
example,  some  of  these  variables  that  can  be  prescribed  based  on 
individual  student  need  and  progess  are  sequence,  amount  of 
information,  instructional  control,  time  on  task,  use  of  text  and 
visuals,  cooperative  learning,  simulations,  and  others  that  an 
expert  teacher  may  employ  to  facilitate  learning. 
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In  svunmary,  the  next  generation  of  ICAI  will  differ  from 
conventional  ICAI  on  several  important  variables.    First,  with 
foundations  in  learning  and  instructional  theory,  ICAI  wll  use  a 
comprehensive  meta-lsarning  model  which  would  take  individual 
differences  into  account  in  the  assessment  and  diagnosis 
processes,  and  make  reference  to  both  the  learner's  acquisition 
(i.e.  storage)  and  the  retrieval  of  knowledge.    Conventional  ICAI 
programs  follow,  for  the  most  part  (if  any) ,  learning  models 
based  on  the  assumptions  of  a  discovery  form  of  learning. 
Second,  ICAI  will  make  no  assumption  for  a  given  strategy  of 
instruction;  rather,  the  strategies  of  instruction  will  be 
selected  from  a  rich  base  of  instructional  variables  according  to 
learning  objectives  and  the  structure  of  information  to  be 
learned.    Third,  ICAI  will  employ  the  concepts  of  artificial 
intelligence  in  the  form  of  informal  heuristics  (as  well  as 
formal  heuristics)  that  have  the  capacity  to  learn  and, 
therefore,  to  adjust  according  to  given  situations. 

The  proposed  educationally-based  ICAI  systems  can  be 
characterized  as  decision-making  systems  that  are  iterative  in 
nature  such  that  with  experience,  they  can  continuously  improve 
the  learning  of  each  learner.    This  would  be  done  by  an  adaptive 
management  system  which  concurrently  diagnoses  learning  while 
prescribing  instruction.    By  monitoring  learner  progress  during 
the  actual  acquisition  of  information,  the  educationally-based 
system  will  improve  learning  in  terms  of  both  the  effectiveness 
of  amount  and  quality  of  knowledge  acquired  and  the  efficiency  in 
time  r squired  to  learn. 

At  both  thfe  curricular  and  the  instructional  levels,  the 
variables  defined  in  this  paper  would  interact  in  an  almost 
infinite  number  of  instructional  conditions  and  events.  Of 
special  note  will  be  the  ability  of  the  entire  system  to  adjust 
decision  making  parameters  both  with  group  experience  and  by 
individual  learner  experiences.    That  is,  as  experience  is  gained 
from  both  sources,  the  heuristics  which  are  formed  with  currently 
available  information  and  data,  would  adjust  accordingly. 
Because  the  heuristics  would  be  independent  of  both  hardware  and 
software  conditions,  they  would  be  easily  transferred  and 
generalized  to  other  systems  as  well  as  accomodating  new 
development  in  both  hardware  and  software. 

A  n\imber  of  major  advantages  can  be  implied  by  the  use  of 
the  proposed  educational  elaborations  and  extensions  of  the 
current  generation  ICAI  systems.    For  example,  the  next 
generation  ICAI  systems  would  be  designed  to  improve  learning  by 
integrating  learning  theory  with  instructional  design.  Also, 
the  systems  would  employ  a  holistic  approach  of  pre- information 
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and  continuing  information  processing  about  the  learner,  rather 
than  diagnosing  and  remediating  specific  problems  as  seen  In 
conventional  AI  programs.    Furthermore,  the  systems  would  be 
active  rather  than  passive  in  nature,  and  would  be  able  to 
recognise  the  totality  of  the  individual  and  the  complexities 
involved  in  creating  favorable  learning  environments  to  Improve 
learning. 

In  conclusion,  we  are  proposing  that  the  next  generation  of 
ICAI  be  based  on  educational  and  psychological  theory  and 
research  findings.    That  it  employ  where  appropriate  the  tools 
and  shells  of  AI  and  expert  systems  methods,  but  that  such  tools 
do  not  dictate  or  control  the  design  and  implementation  of  the 
learning  environment.    Much  like  educators  have  for  decades  used 
the  research  tools  from  the  «xeld  of  statistics  for  help  in 
experimentation,  we  can  use  the  tools  offered  by  computer  science 
in  the  design  of  leaiTiing  enviomments.    In  both  situations, 
however,  the  educator  most  control  the  tools  as  a  means  to  the 
end,  not  as  the  end  in  themselves  as  in  the  current  prototype 
applications  of  ICAI. 
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Abstract 

Two  assessment  endeavors  were  undertaken  to  determine  the  relative  impact  of 
alphanumeric  and  graphic  instructional  mediators  upon  Intentional  and  incidental  learning 
outcomes  In  applied  Instructional  contexts.  The  Intent  of  these  investigations  was  to  determine 
the  feasibility  of  embedding  strategic  organizational  cues  within  instruction  to  improve  intentional 
learning  outcomes  In  contexts  where  direct  Interactive  feedback  opportunities  are  limited. 
Results  indicated  that  alphanumeric  and  graphic  displays  both  provided  organizational  frameworks 
for  subjects  to  use  in  Immediate  recall  exercises,  and  that  facilitation  effects  for  alphanumeric  and 
graphic  displays  were  not  maintained  in  delayed  recall  exercises. 
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Introduction 

Determination  of  the  Impacts  of  media  upon  learning  has  been  an  Issue  of  considerable 
activity  and  the  focus  of  much  debate  among  American  educational  researchers.  During  the  sixty- 
plus  years  In  which  such  studies  have  been  undertaken  It  has  become  clear  that  comparative 
media  studies  have  not  been  able  to  offer  clear  evidence  of  superiority  of  one  medium  over 
a^'other  with  regard  to  learning  facilitation  (Clark,  1983).  As  more  and  more  technologies  of 
Instruction  have  beconrte  increasingly  available  for  use  in  instructional  contexts.  It  Is  Increasingly 
less  clear  that  there  Is  value  In  identifying  a  hypothe»'cally  "best  medium".  Even  as  the  Interest  In 
selecting  an  optimal  medium  has  shifted  from  a  product  driven  perspective  to  one  which  Is  more 
process  driven  (Wagner.  1986),  Interest  In  assessing  message  design  efficacy  for  applications 
across  media  continue  to  grow.  There  appears  to  be  a  shift  toward  developing  strategies  to 
Improve  the  efficiency  with  which  Instructional  messages  are  designed  so  that  their  delivery  via 
appropriately  selected  media  (that  is,  media  selected  by  virtue  of  their  appropriateness  for  the 
learning/teaching  task  at  hand)  is  facilitated. 

Even  so,  the  recent  resurgence  of  interest  in  distance  education  (Moore.  1988)  may  have 
Inadvertently  contributed  to  renewed  attempts  to  discovei  a  "best  medium"  for  use  in  distance 
educational  endeavors.  The  contemporary  distance  educator's  Interest  lies  in  developing 
instructional  delivery  systems  making  use  Interactive  audio  teleconferencing,  audiographic 
teleconferencing.  Interactive  compressed  video  teleconferencing,  full  motion  video 
teleconferencing  and  Interactive  and  asynchronous  computer  teleconferences  to  transmit  "data, 
video  and  voice"  in  single  through  multi-modal  delivery  systems  carried  via  satellite,  coaxial  cable 
or  fiber  optics.  A  resurgent  Interest  in  trying  to  identify  the  best  medium  for  distance  delivery 
applications  has  provided  investigators  with  new  opportunities  to  consider  instructional  delivery  / 
instructional  mediation  strategies.  Perhaps  distance  educational  applications  of  "high  tech" 
instructional  delivery  systems  are  to  serve  as  a  reminder  that  while  the  media  carrying  instructional 
messages  may  demand  attention  by  virtue  of  their  technological  complexity,  their  complexity  does 
not  necessarily  correlate  with  Instructional  efficiency.  By  focucing  upon  the  selection  and 
utilization  of  technologies  of  lr.structional  delivery  as  the  means  through  which  instructional 
messages  are  to  be  transmitted,  It  becomes  easier  to  focus  upon  instructional  message  design 
and  devetopment  as  a  primary  arena  off  endeavor.  In  order  to  accommodate  the  rapidity  with  which 
technological  delivery  systems  are  rendered  obsolete,  the  emphasis  off  strategy-based 
Investigations  n^ied  to  focus  upon  the  characteristics  and  ffuhclions  off  the  instructional  messages 
being  carried  by  means  of  targeted  media,  rather  than  considering  simply  the  transmission  efffficacy 
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of  the  media  themselves.  In  taking  this  approach,  generalizable  strategies  generated  for  use 
across  a  wide  variety  of  Instructional  delivery  systems  may  be  more  likely  to  emerge. 


The  ability  of  a  novice  learner  to  extract  critical  information  provided  by  an  expert  in 
instructional  situations  may  be  hampered  by  the  novice's  Inability  to  discriminatg  between  those 
bits  of  information  which  ara  critical  for  developing  a  conceptual  framework  and  those  bits  of 
information  which  are  incidentally  related  to  the  learning  task  at  hand.  In  situations  where 
opportunities  for  direct  interaction  between  expert  and  novice  are  limited,  (e.g.  large  lecture  hall 
instruction,  teleconferenced  instruction)  learning  to  discriminate  between  critical  and  incidental 
ii.'ormation  may  be  further  hampered. 

Merrill  &  Tennyson  (1977)  determined  that  the  presentation  form  of  information  clearly 
affected  the  form  of  knowledge  encoded  in  memory.  Merrill's  Component  Display  Theory  (1983) 
proposed  that  secondary  presentation  forms  can  be  embedded  in  a  sequence  of  instruction  to 
aid  learning.  Specifically,  the  descriptive  part  of  the  theory  provided  a  performance  content  matrix 
for  classifying  instructional  outcomes  and  primary  and  secondary  presentation  forms  for 
describing  presentation  displays.  The  prescriptive  parts  of  the  theory  provided  consistency  rules 
which  suggested  that  learning,  resulting  from  instruction,  is  most  efficient  and  effective  if 
combinations  of  primary  and  secondary  forms  are  used  to  promote  classes  of 
performance/content  outcomes  (Merrill,  1987,  p.  19). 

Design  considerations  focused  toward  the  facilitation  of  concept  acquisition  have 
included  concerns  for  instructional  strategies  (i.e.  expository,  interrogatory  methods  of 
information  presentation)  as  well  as  organizational  and  aesthetic  presentation  considerations. 
Tennyson  &  Cocchiarella  (1986)  have  suggested  that  concept  teaching  can  facilitate  the 
instructional  design  process  through  the  employment  of  instructional  strategies  aimed  at  effective 
formation  of  concept  knowledge  and  corresponding  procedural  skills.  Gagne's  (1985)  learning 
hierarchy  states  that  the  ability  to  discriminate  presupposes  the  ability  to  acquire  concepts;  from 
an  applied  perspective,  the  ability  to  categorize  and  classify  attributes  to  form  concepts  clearly 
assumes  the  ability  to  select  intentional  attiibutes  from  non-intentional  attributes. 

Use  of  visual  display  categories  to  facilitate  concept  acquisition  has  been  included  among 
the  example/non-example  design  variables  considered  in  empirical  investigations.  McLean.  Yeh  & 
Reigeluth  (1983)  found  that  a  visual-only  format  was  superior  to  either  a  verbal  format  or  a  visual- 
verbal  combination  when  teaching  conceptual  relationstiips  to  high  school  students.  McLean  et 
al  were  concerned  with  assessing  the  strategic,  organizational  impact  of  visual  and  verbal 
presentation  forms  upon  immediate  and  delayed  recaH*tasks.';The  utilization  of  secondary 
presentation  forms  in  conjunction  with  a  large  lecture  and  teleconferenced  presentations  appear 
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to  be  similar  In  intent  and  focus  to  the  McLean  et  al  study.  Botli  the  present  study  and  the 
McLean  et  al  study  appear  to  provide  a  basis  for  establishing  an  organizational  frameworit  through 
which  Investigations  to  determine  instructional  efficacy  of  embedded  secondary  presentation 
forms  may  be  undertalten. 

Research  describing  message  transmissiOn/recepton  effects  of  prose  and  pictorial  stimuli 
may  also  have  direct  applicability  upon  graphic  and  alphanumeric  recall  facilitation  effects  for 
instructional  applications  .  Anglin  (1987)  has  suggested  that  there  is  ample  evidence  to  support 
the  notion  that  pictures  can  be  used  to  facilitate  the  recall  of  information  presented  in  prose 
passages.  Much  of  Anglin's  worit  has  been  based  upon  Levin's  (1981)  theoretical  frameworit 
describing  functional  attributes  of  prose-relevant  pictures.  Levin  (1981)  proposed  a  frameworit  to 
represent  seven  distinct  functions  to  be  served  by  prose-re!evant  pictures.  This  framework 
included  the  categories  of:  decoration;  remuneration;  motivation;  reiteration;  representation; 
organization;  interpretation;  and  transformation.  Anglin  (1987)  proposed  that  the  function  of  a 
representational  picture  is  to  make  the  information  contained  in  a  prose  passage  more  concrete; 
Levin  (1981)  had  previously  suggested  that  representational  pictures  would  have  a  moderate 
learning  facilitation  effect,  while  transformational  pictures  would  make  the  information  in  a  prose 
passage  more  memorable. 

Even  before  Levin  and  others  began  looking  at  picture  function  in  prose  applications, 
researcher  have  investigated  the  impact  of  verbal  and  pictorial/imaginal  systems  upon  memory 
processes.  Paivio  (1969)  asserted  that  images  and  verbal  processes  function  as  effective 
alternate  memory  coding  systems  because  they  are  closely  linked  to  experience  with  concrete 
objects,  events  and  language.  He  proposed  a  two-process  Theory  of  Meaning  and  Mediation 
which  suggested  that  there  are  two  distinct  modes  of  information  represented  in  memory:  a  verbal 
mode  and  a  visual  mode.  While  Paivio's  interest  in  imagery  stressed  imagery  as  informational 
representation  in  memory,  his  investigations  provided  a  foundation  upon  which  examinations  of 
the  information  transmission  potentials  of  pictures  could  be  structured.  Nelson,  Reed  &  Walling 
(1976)  found  that  memory  for  pictorial  stimuli  generally  exceeded  memory  for  their  concrete  labels 
because  pictures  were  more  likely  to  be  encoded  as  both  imaginal  and  verbal  codes.  They  also 
indicated  that  pictorial  Image  codes  may  be  qualitatively  superior  to  verbal  codes  when  dealing 
with  simple  pictures.  Pellegrino  et  al  (1976)  indicated  that  pk:ture  retention  was  superior  to  word 
retention  for  long-term  memory,  suggesting  that "  a  dual  coding  position  maintains  that  there  is  a 
separate  visual  and  acoustic  representation  for  the  picture  stimuli  and  only  an  acoustic 
representation  for  the  word  stimuli."  (p.  535) 

The  purpose  of  the  present  studies  was  to  determine  the  facilitative  impact  of 
alphanumeric  and  graphic  symbols  upon  recall  of  interilional  dnd  incidental  information  presented 
in  a  variety  of  instructional  contexts.  Additionally,  it  attempted  to  investigate  possible 
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contributions  of  alphanumeric  and  graphic  symbols  upon  the  re.terative  and  organizational 
functions  in  instructional  applications.  The  symbolic  representational  systems  employed  in  this 
study  function  directly  as  secondary  presentation  forms  (l^errill.  1983);  they  bear  a  p..ssing 
resemblance  to  Levin's  (1981)  prose-relevant  picture  functions,  and  may  also  function  as  cues  as 
described  by  Beck  (1984).  The  organizational  strategy  and  delivery  strategy  variables  described 
by  Reigeluth  &  t^errill  (1979)  may  provide  a  better  conceptual  framework  for  classifying  the 
Instructional  variables  underlying  this  discussion.  Nevertheless,  the  determination  of  similarities 
belv/een  Levin's  functional  framework  and  Merrill's  secondary  presentation  forms  may  ultimately 
provide  some  guidance  for  selecting  appropriate  presentation  forms  to  elicit  specific  instructional 
outcomes. 

The  studies  described  herein  took  place  in  a  large  lecture  instructional  context  and  a 
simulated  enhanced  audio  teleconference  context.  Materials  employed  in  both  contexts 
remained  constant;  assessment  of  immediate  and  delayed  recall  efficacy  of  intentional  and 
Incidental  items  also  remained  con'    .  Specific  questions  to  be  answered  as  a  consequence  of 
these  investigations  included: 

*  Would  the  use  of  alphanumeric  and  graphic  symbols  in  conjunction  with  a  (taped)lecture 
improve  subjects  performance  on  a  recall  exercise"? 

*  Would  the  means  of  transmission  of  the  alphanumeric  and  graphic  symbols  impact 
performance  efficacy? 

*  Would  recall  of  intentionally  reiterated  information  be  facilitated  over  time  as  a 
consequence  of  exposure  to  either  alphanumeric  or  graphic  symbols  during  the 
encoding  process? 

Method  -  Study  1 

Subjects 

1 38  (23  male,  1 1 5  female)  subjects  wpre  recruited  from  an  educational  technology 
course  for  pre-service  teachers.  Subjects  wer  provided  with  extra  course  credit  lor  their 
participation  in  the  experimental  exercise  if  they  completed  both  the  initial  recall  assessment  and 
the  delayed  recall  assessment  one  week  later. 


Design 

A  2  X  3  design  was  employed.  Immediato  and  delayed  recall  was  compared  across 
graphic,  alphanumeric  and  control  groups.  General  recall,  recall  of  intentional  items  and  recall  ol 
incidental  items  were  compared.  ANOVAs  were  performed  to  determine  significant  differences 
among  means  scores  per  recall  exercise  per  experimental  conditions 
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Materials 

A  lecture  describing  a  hypothetical  communications  holding  company  was  developed  to 
to  control  for  prior  knowledge  effects.  An  elaborative  structure  was  used  in  the  presentation  of 
conceptual  information  about  the  company  and  its  related  subsidiaries,  while  information  about 
each  company  was  presented  in  an  expository  manner.  The  7  minute.  21  second  lecture  was 
recorded  on  audiotape  and  dubbed  to  three  separate  cassette  tapes  to  provide  for  identic:;; 
content  and  information  presentation  in  the  various  treatment  sessions.  Tv/o  sets  of  four 
overhead  transparencies  each  were  prepared  to  accompany  the  taped  lecture.  One  set  displayed 
line  drawings  in  which  spatial  relationships  described  in  the  tape  were  emphasized;  the  other  set 
displayed  lists  of  alphanumeric  descriptors  reiterating  verbal  information  transmitted  on  the  tape, 
which  presented  equivalent  information  to  that  which  was  displayed  in  the  graphic  transparencies. 
Two  equivalent  recall  tests  of  24  items  each  were  developed,  one  for  use  immediately  the  control 
/  treatment  conditions  (Test  #1)  and  for  a  one-week  delayed  test  (Test  #2) .  The  recall  tests 
included  10  items  dealing  with  information  included  on  the  verbal  and  grapfiic  transparencies; 
these  were  coded  as  Intentional  recall  items.  The  recall  tests  also  included  10  items  dealing  with 
information  which  was  mentioned  on  the  audiotaped  lecture,  but  were  not  visually  presented 
either  in  graphic  or  verbal  presentation  modes;  these  were  coded  as  incidental  recall  items.  A 
demographic  assessment  instrument  was  employed  to  obtain  descriptive  information  about  each 
member  in  the  control  and  experimental  groups. 

Procedure 

All  subjects  reported  as  a  group  to  the  lecture  hall  in  which  their  class  was  normally  held. 
Subjects  were  randomly  assigned  to  one  of  three  groups  by  means  of  a  counting  off  procedure. 
Members  of  each  group  then  re-convened  in  a  room  designated  per  the  number  assigned  dunng 
the  counting  off  procedure.  Group  1  (45  S's)  listened  to  an  audio  tape  only  presentation;  Group  2 
(40  S's)  was  presented  with  the  audiotape  /  graphic  lesson  presentation  and  Group  3  (53  S's)  was 
presented  with  the  audio  tape  and  the  verbal  list  presentation. 

All  three  groups  were  instmcted  to  listen  to  the  audiotaped  presentation.  During  the 
taped  lecture,  groups  2  and  3  were  shown  the  transparencies  respectively  at  appropriate, 
simultaneous  points  during  the  audio  taped  presentation,  while  Group  1  was  provided  only  with 
the  audio  taped  presentation.  At  the  conclusion  of  the  taped  presentation,  all  subjects  were 
instructed  to  complete  the  recall  exercise  (Test  #1).  After  a  delay  of  1  week,  subjects  reported  to 
their  standard  lecture  hall,  and  as  a  group,  individually  completed  recall  assessment  Test  #2. 

Results 
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An  analysis  of  variance  was  conducted  for  the  three  groups  scores  on  Test  #1  and  a 
repeated  measures  analysis  was  conducted  for  Test  #2.  Results  showed  that  for  Test  1  there 
were  significant  differences,  F  (2, 1 35)  =  4.34.  p<  .01 ,  between  the  control  and  the  experimental 
groups  when  assessing  general  recall  efficacy.  Significant  differences  were  reported  for  the 
immediate  recall  efficacy  of  intentional  items,  F  (2, 1 35)  =  7.41 .  p<  .01 .  between  the  control  and 
experimental  groups.  A  Neuman  Keuls  multiple  comparison  confirmed  that  experimental  groups 
out-performed  the  control  group  (p<  .05)  for  both  general  recall  and  intentional  recall  tasks  but 
that  neither  the  graphic  nor  the  verbal  displays  were  superior  In  their  facilitation  effect,  either  for 
general  recall,  for  recall  of  critical  Items  or  for  recall  of  incidental  items.  The  repeated  measures 
ANOVA  for  groups'  scores  on  Test  #2  showed  no  significant  differences  among  means  when 
assessing  general  delayed  recall,  the  delayed  intentional  recall  or  the  delayed  incidental  recall. 

Method  -  Study  2 

Materials 

The  same  7  minute,  21  second  taped  lecture  describing  a  hypothetical  communication 
holding  company  was  used  in  the  second  study.  Three  separate  cassette  tapes  provided  for 
identical  content  and  information  presentation.  The  same  two  transparencies  were  employed  in 
the  second  study  as  had  been  used  in  Study  1 :  one  set  displayed  line  drawings  in  which  spatial 
relationships  described  in  the  tape  were  depicted,  while  the  other  set  displayed  lists  of  verbal 
descriptors  to  present  the  same  concepts  displayed  In  the  graphic  transparencies.  The  same  two 
equivalent  recall  tests  were  used .  as  was  the  same  demographic  assessment  instrument. 

Subjects 

44  (14  male,  30  female)  volunteer  subjects  were  recruited  from  an  educational 
technology  course  for  pre-service  teachers.  Subjects  were  provided  with  extra  course  credit  for 
their  participation  in  the  experimental  exercise  if  they  completed  both  the  initial  recall  assessment 
and  the  delayed  recall  assessment  one  week  later. 

Procedure 

Students  enrolled  in  the  pre-service  teacher  educational  technology  course  were  Invited 
to  participate  in  an  (simulated)  enhanced  audio  teleconference;  they  were  also  told  that  the 
telecon;erence  would  include  an  assessment  exercise  in  which  all  teleconference  attendees 
were  expected  to  participate.  Students  were  asked  to  sign  up  for  a  specific  time  during  which 
teleconferences  were  to  be  conducted.  Members  of  each  group  were  asked  to  re  convene  in  a 
"teleconference  room"  at  the  time  selected  by  each  participant  on  the  sign-up  sheet.  Group  1 
(14  S's)  was  provided  with  an  audio  tape  only  presentation;  Group  2(15  S's)  was  presented  with 
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the  audiotape  /  graphic  iesson  presentation  and  Group  3  (15  S's)  was  presented  with  the  aud»o 
tape  and  the  verbal  list  presentation. 

At  the  commencement  of  each  session,  all  subjects  were  greeted  by  a  site  facilitator  and 
were  told  thai  further  instructions  would  be  forthcoming  via  an  expected  teleconference  call.  The 
site  facilitator  answered  the  Incoming  phone  call;  subjects  were  greeted  by  a  ''teleconference 
presenter"  who  described  the  procedures  to  be  followed  during  the  experimental  endeavor. 
(The  "teleconference  presenter"  was  actually  the  course  instructor,  making  the  call  from  an  office 
telephone  just  down  the  hall  form  where  the  subjects  were  convened.)  Eacti  of  the  three  groups 
were  told  to  listen  to  the  audiotaped  presentation.  As  in  Study  1 ,  Groups  2  and  3  were  shown  the 
transparencies  respectively  developed  per  group  at  appropriate,  simultaneous  points  during  the 
audio  taped  presentation  by  the  site  facilitator,  while  Group  1  was  provided  only  with  the  audio 
taped  presentation.  At  the  conclusion  of  the  taped  presentation,  all  subjects  were  instructed  to 
complete  the  recall  exercise  (Test  #1 ).  After  a  delay  of  1  week,  subjects  reported  to  the  room  in 
which  the  simulated  teleconference  had  been  held;  as  a  group,  individuals  completed  recall 
assessment  Test  #2. 

Results 

An  analysis  of  variance  was  conducted  for  the  three  groups  scores  on  Test  #1  and  a 
repeated  measures  analysis  was  conducted  for  Test  #2.  Results  showed  that  for  Test  1  ihere 
were  significant  differences  F  (2,  42  )  =  3.27,  p<  .05,  between  the  control  and  the  exporirnontal 
groups  when  assessing  general  recall  efficacy.  Significant  differences  were  reported  for  tli« 
recall  efficacy  of  intentional  recall  items  F  ( 2, 42)  =  5.41 .  p^  .01 ,  between  the  control  and 
experimental  groups.  A  Nejman  Keuls  multiple  comparison  confirniod  that  exponniontal  groups 
oul-performed  the  control  group  (p<  .05)  for  both  the  general  recall  a.id  the  iniinediato  recall  tasks 
but  that  neither  the  graphic  nor  the  verbal  displays  were  superior  in  ttieir  facilitation  e'forl.  cither 
for  general  recall  or  for  recall  of  intentional  items.  There  were  no  significant  dilferencos  among 
experimental  groups  and  the  control  group  when  assessing  recall  efficacy  of  the  incidontal  recall 
items.  The  repeated  measures  ANOVA  for  groups'  scores  on  Test  #2  showed  no  significant 
differences  among  means  when  assessing  general  delayed  recall,  ttie  delayed  intentional  recall 
or  the  delayed  incidental  recall. 

Discussion 

The  results  of  the  analysis  of  data  derived  from  the  first  study  indicated  that  conceptual 
Information  and  information  describing  relationships  among  conceptf^  which  i3  prosenled  in  a 
large  lecture  instructional  environment  is  better  recalled  when  reite-ntive.  socondary  pronontation 
forms  accompany  the  initial  presentation.  These  results  were  maintained  in  tho  second  study. 
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even  though  the  context  of  instructional  delivery  had  been  altered  from  tnat  of  a  large  lecluro  to 
that  of  an  audio  teleconference..  The  use  of  adjunctive  facilitators  such  as  transparencies 
significantly  improved  student  performance  upon  a  written  recall  exercise  administered 
immediately  after  the  presentation  of  information  in  both  cases.  There  was  no  significant 
difference  between  alphanumeric  symbol  facilitation  and  graphic  symbol  facilitation  wlien 
considering  overall  recall  performance,  although  there  did  appear  as  if  the  graphic  transparencies 
demonstrated  marginal  superiority  in  improving  recall  performance. 

Data  derived  from  the  second  study  indicated  that  conceptual  inforniation  and  information 
describing  relationships  among  concepts  which  is  presented  in  a  (simulated)  audiOQr;;pliic 
teleconference  is  better  recalled  when  reiterative,  secondary  presentation  forms  accompany  the 
initial  presentation.  The  use  of  adjunctive  facilitators  such  as  transparencies  significantly  irnproved 
student  performance  upon  a  written  recall  exercise  administered  immediately  after  the 
presentation  of  Information.  There  was  no  significant  difference  between  alphanumeric  symbol 
facilitation  and  graphic  symbol  facilitation  when  considering  overall  recall  performance.  As  in  the 
first  study,  the  graphic  mediators  demonstrated  marginal  superiority  to  the  verbal  mediators. 

In  both  studies  the  alphanumeric  and  graphic  displays  were  employed  as  a  means  of 
providing  an  organizational  structure  within  which  novice  learners  would  be  better  able  to  discern 
critical  information  from  incidental  information.  As  such,  the  displays  were  not  use  to  maintain 
attention,  nor  were  they  used  to  decorate  or  add  interest  to  the  instructional  materials  (Beck, 
1984).  Using  Levin's  theoretical  function  of  prose-relevant  pictures  as  benchmarks,  one  can  also 
discern  that  the  display  forms  used  in  these  three  studies  did  not  compensate  for  the  relative 
inability  of  verbal  presentation  forms  to  transmit  information,  they  did  not  motivate  subjects  lo 
recall  information  more  efficiently,  they  did  not  represent  information,  they  did  not  aid  in  ttie 
interpretation  of  information,  nor  did  they  assist  in  the  transformation  of  meaning  Of  course,  it  is 
also  important  to  keep  in  mind  that  while  these  benchmarks  provided  in  Levin's  ( 198 1)  prose- 
relevant  picture  framework  can  be  used  in  this  context,  they  were  not  generated  for  use  with  both 
alphanumeric  and  graphic  presentation  forms.  The  alphanumeric  and  graphic  display  forms  were 
used  10  assist  in  the  reiteration  of  verbally  presented  information  by  means  of  secondary 
presentation  modes,  while  assisting  in  the  generation  of  an  externally  imposed  organizational 
framework  through  which  recall  could  be  facilitated.  Even  though  the  instructional  process  is 
generally  desribed  as  an  interactive  one.  many  presentation  modes  encourage  greater 
dependence  upon  one-way  transmission  of  information.  In  large  lectures  and  in  many  varieties  of 
teleconferencing,  the  interaction  between  teacher  and  student  is  implied  more  tlian  it  is  p.acticed; 
interaction  may  certainly  be  accomodated  in  these  presentation  modes,  but  is  not  nocessanly 
encouraged.  By  embedding  secondary  presentation. forms  in  a  sequence  of  iiistruclion.  ttiey 
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may  function  as  alternative  representations  (Van  Patten.  Chao  &  Reigeluth.  198G)  through  whicli 
learning,  represented  in  this  study  by  recall  efficacy,  may  have  been  more  efficient  and  effective 

These  investigations  were  designed  to  simulate  and/or  replicate  typical  instructional 
situations  in  which  opportunities  for  interaction  and  feedback  were  limited.  For  this  reason,  tlie 
assessment  of  performance  outcomes  elicited  by  means  of  Ihe  experimental  materials  occurred  in 
two  discrete  instructional  contexts.  Even  so,  limitations  which  directly  impacted  attempts  to 
simulate  a  true  instructional  situation  need  to  be  acknowledged.  Actual  time  spent  learning  the 
taped  lecture  information  was  relatively  short,  and  is  not  characteristic  of  typical  instructional 
situations.  Similarly,  the  only  practice/rehearsal  opportunity  provided  for  subjects  provided  during 
the  one-week  delay  period  occurred  with  the  administration  of  the  first  recall  assessment  exercise 
(Test  #1).  The  lack  of  significance  in  the  delayed  recall  assessments  in  both  the  alptianumeric  or 
the  graphic  conditions  was  most  likely  due  to  the  brevity  of  the  treatment  timo  Aiiglin  (1987) 
demonstrated  that  prose  relevant  picture  retention  has  beer»  riiaintniuod  for  sovoral  weeks: 
Mandler  &  Parker  (1976)  indicated  that  retention  of  spatial  relationships  from  meaningful  pictures 
can  be  retained  for  well  over  one  week's  time. 


Conclusions 

The  ability  of  a  novice  learner  to  extract  critical  information  provided  by  an  expert  may  be 
hampered  by  the  novices  inability  to  discriminate  between  those  bits  of  information  wtiich  are 
critical  for  developing  a  conceptual  framework  and  those  bits  of  information  which  are  not  critical. 
In  situations  where  interaction  may  be  limited  it  may  be  even  more  difficult  to  learn  how  to 
discriminate  between  intentional  and  incidental  information.  Immediate  recall  of  information 
kjentified  as  critical  and  reiterated  by  means  of  alphanumeric  or  graphic  symbols  wns  facilitated  in  a 
large  lecture  context  and  in  a  simulated  enhanced  audio-teleconferonco  by  m(?atis  of  employing 
secondary  presentation  forms  to  reiterate  critical  information  and  to  provide  an  oiganiraliorial 
framework  to  facilitate  recall  of  intentional  information. 
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PREDICTING  BEHAVIOR  FROM  NORMATIVE  INFLUENCES: 
What  insights  can  the  Hshbcin  Model  Qffer? 

The  Fishbein  Model  is  an  attitude  behavior  cxmsistency  model  based  oa  a  recursive  causal  chain 
structure  which  places  noimative  influences  in  the  middle  of  the  chain;  Acted  upon  by  beliefs  and 
in  turn  acting  on  behavioral  intentions.  The  nonnative  con^)onent  is  ccxisidered  a  major  factor  for 
influencing  behavioral  intentions  alcxig  with  an  attitudinal  component  This  paper  examines 
controversy  surrounding  die  Fishbdn  Model's  normative  compment  Results  from  a  study  of 
microcomputer  use  are  presented  and  implications  for  educational  research  and  practice  are 
examined. 


The  Bdrt)ein  Model 


The  F*shbein  Model  is  based  on  Fishbein  and  Ajzen*s  theory  of  reasoned  action  which  presents 
progressive  levels  of  specificity  towards  understandmg  the  relationship  between  beliefs  and 
behavior  (See  Fig.  1). 


BEHAVIOR 


INTENTION 


.Relative  Weights. 


ATTITUDE. 


5UB 


SUBJECTIVE. 
NORM 


Behavioral        Importance  Normative  Motivaticxi 

BELIEFS        of  outcomes  BELIEFS  to  comply 

about  about  what  with  what 

outcomes         inqxsrtant  ethers  think 

referents 

think  should 

be  done 


Fig.  1 -Relationships  beween  components  of  the  thfX)ry  of  reasoned  action. 

Attinides  and  subjective  norms  are  the  predictors  of  behavioral  intentions  in  the  nxxlel.  The 
weighting  factors  indicate  their  relative  importance  to  the  behavior  under  consideration.  Cialdini, 
Petty  and  Cacioppo  (1981)  reported  the  normative  cmcq  caused  matt  controversy  than  the 
attitude  concept  due  to  the  varying  nature  of  the  component  weights.  Studies  have  found  attitudes 
contributing  more  than  subjective  norms  (Loken  &  Fishbein,  1980)  and  subjective  norms 
contributing  more  tiian  attitudes  (Kantola,  Syme  &  Campbell,  1982).  In  general,  however, 
attinides  have  been  found  to  ccxisistendy  cmtribute  more  to  behavioral  intentions  (Galdini  et  al, 
1981). 
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,  ,.9*??'*j?^^<*'^  ^     normative  component  of  the  model  are  both  naethodological  and  rational 
VMiniard  &  Cohen.  1979. 1981).  They  focus  on  operational  definitions  of  normative  referents, 
unipolar  vs  bipolar  measurement  and  specificity  of  behavioral  domain.  Fishbein  and  Azjen  (198 1) 
have  countered  criticisms  rationaUy  and  enqniically  with  refinements  to  norawtive  measurement. 
In  ttwif  view,  unipolar  measurement  at  the  general  level  reflects  the  positive  motivation  to  comply 
with  people  who  are  in^wrtant  to  the  individual.  They  do  indicate  scaling  and  specificity  level  may 
be  related.  Bipolar  measurement  may  be  useful  if  motivation  to  conroly  is  spedfied  at  an 
mtemiediaie  radier  than  general  level 

The  Fishbein  Model  of  behavioral  intentions  is  used  widely  in  both  laboratory  and  field  settings 
for  predicting  and  understanding  attitudinal  and  normative  influences  on  behavior.  One  of  the 
strengths  of  die  ooodei  is  its  flexibility  for  behavior  and  population  sokASc  measuremenL  By 
using  basic  principles  for  creating  questionnaires  (Ajzen  and  Fishbem.  1980)  results  are  diiecdy 
based  on  beliefs  of  the  target  populaticm.  A  sample  of  the  population  is  interviewed  to  obtain  die 
urfonnation  which  generates  question  constiiiction.  The  study  presented  below  used  this  method 
for  examining  library  and  information  science  (LIS)  student's  attitudes  toward  microcomputer  use. 

Normative  Influences  on  LIS  students'  microconq)uter  use 

four  criteria  of  specificity  are  involved  in  applying  the  Fishbein  Model  to  understanding  and 
PJSSf^^  ^^^S®**         con''*'^^  and  time.  The  study  tfiis  paper  is  based  on  (Walster, 

1986)  applied  the  complete  Rshbein  Model  to  two  behaviors  which  differed  only  in  their  action 
elements:  learning  to  use  a  microcoaq)uter  and  using  a  microcomputer.  Con^aring  student's 
re^nses  under  educational  and  non-educational  conditions  resulted  in  identification  of  areas 
where  the  action  of  learning  imluenced  con^nents  of  the  noodel. 

For  purposes  of  this  discussion  only  the  normative  in^lications  of  the  study  will  be 
considered.  Based  on  die  problems  witfi  the  nonmative  coo^nent  found  in  die  literature,  two 
issues  are  examined.  The  first  is  the  type  of  referent:  who  were  important  normative  influences 
and  what  were  their  characteristics?.  The  second  is  a  measurement  issue:  Whi  affect  does 
umpolar  or  bipolar  scaling  have? 

Nomiative  Reforms 

The  same  eight  normative  referents  were  identified  in  interviews  by  die  learning  to  use 
imcrocomputers  and  the  using  microcomputers  groups  as  salient  Six  were  positive  referents: 
Library  users,  professors,  future  enyloyers.  people  who  use  computers,  family  and  friends.  Two 
were  negative  referents:  People  against  technology  and  people  tiireatened  by  computers. 
Companng  the  groups'  responses  to  diese  eight  referents,  significant  differences  were  found  for 
only  one  normative  ir.ferent  (See  Table  1).  Students  in  the  learning  group  felt  it  was  significantiy 
more  likely  professars  would  be  in  favor  of  their  learning  to  use  a  microcomputer. 
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Tabic  1.  T  values  and  means  for  noraiative  beliefs  (normative  referents). 


Referents  Group 

fi 
11 

M 

SD 

df 

t 

Professors 

Learning 

36 

2.53 

0.56 

2.96* 

Using 

51 

1  QT 

n  07 

66 

Future 

Learning 

36 

2.39 

0.77 

employers 

Using 

3^ 

Z.Uj 

66 

1.73 

Peq[>le  using 

Leamii\g 

36 

2.25 

0.99 

1.04 

computers 

Using 

32 

2.00 

A  no 

66 

Friends 

Learning 

36 

1.06 

1.04 

n  gA 

Using 

32 

A  OA 

0.84 

u.yy 

DO 

Family 

Learning 

36 

1.19 

1.19 

66 

0.73 

Using 

32 

1.00 

0.98 

Library  users 

Learning 

36 

0.89 

1.19 

66 

0.16 

Using 

32 

0.83 

1.17 

People  against 

Learning 

36 

-1.14 

1.53 

66 

0.95 

technoloicv 

Using 

32 

-1.47 

1.30 

People  who 

LeaTiiing 

35 

-1.06 

1.39 

65 

0.87 

feel  threatened  by 

Using 

32 

-1.34 

1.29 

technology 

*p<.01 

Both  groups  believed  professors^  people  whv>  use  conaputcrs  and  future  employers  were  most 
likely  to  be  in  favor  of  microownputcr  use.  Family  and  friends  were  judged  by  the  groups  to  be 
only  slighdy  likely  to  favor  microcomputer  use.  People  against  technology  and  people  who  feel 
threatened  by  technology  were  thought  to  be  unlikely  to  favor  microcomputer  use.  These 
judgments  are  what  the  students  believed  the  various  referent  groups  would  like  them  to  do. 

Miniard  and  Cohen  (1981)  stated  that  some  referents  will  be  positive  and  some  referents  wi:i  be 
negative.  The  Rshbein  Model,  however,  assumes  that  only  positive  referents  will  be  influential. 
This  study  resulted  in  positive  and  negative  normative  referents  being  salient  to  both  groups. 
Negative  referents  need  to  be  considered  in  predicting  and  understanding  attitudes  and  belmvior. 

Responses  ro  referents  were  different  between  the  two  groups.  The  learning  group  felt  more 
strongly  about  the  positive  referents  and  less  strongly  about  negative  referents.  The  reverse  was 
true  for  the  using  group.  The  learning  action  influemxd  responses  to  positive  and  negative 
referents.  ^       ,  . 

Study  of  the  affect  of  normative  refeients  in  the  learning  action  could  be  useful  for  the  design 
of  instruction.  In  general,  LIS  education  emphasizes  service  to  the  library  user.  This  study  clearly 
indicated  library  users  were  of  minimal  importance  to  student's  microcomputer  use.  The  future 
employer,  however,  was  a  strong  normative  concern  to  students.  Instracrion  could  be  designed  to 
increase  studait*s  motiv  ition  through  greater  consideration  of  employer  concerns. 

Motivation  to  Comply 

Subjective  norms  consist  of  two  parts:  the  ncnmative  belief  (or  normative  referent)  and  the 
motivation  to  comply.  The  subjective  norm  is  calculated  by  multiplying  normative  belief  times 
nK)tivati(m  to  comply.  The  controversy  over  unipolar  or  bipolar  measurement  relates  specifically  to 
motivation  to  comply.  In  this  study  both  the  learning  group  and  tiie  using  groups'  subjective 
norms  were  calculated  with  unipolar  and  bipolar  scales. 

Using  bipolar  measurement  for  subjectiive  norms  no  significant  differences  were  found  (See 
Table  2).  The  sum  of  subjective  norms  also  showed  no  significant  differences  between  the  groups 
(See  Table  4).  Six  subjecdve  nonns  resulted  in  positive  normative  beliefs  and  positive  motivations 
to  comply:  library  user^.,  professon,  future  employers,  people  who  use  computers,  family  and 
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fticnck.  Two  subjective  nonm  resulted  in  negative  nonnative  beUefs  and  negative  motivations  to 
comply:  people  against  tecnnology  and  people  who  feel  threatened  by  technology. 

Table  2.  T  values  and  means  for  estimates  of  subjective  nomis  using  bipolar 
motivation  to  comply 


Referents  Group         n         M        SD        df  t 


rTOiessors 

Learning 

36 

3.61 

3.43 

UsinjE 

32 

2.50 

2.37 

66 

1.53 

Future 

T  .Mmninir 

'  -Till  F III ilf 

V\ 

JQ 

A  AA 

1  AA 

employees 

Usinff 

32 

3.78 

2.60 

66 

0.89 

People  who  use 

Learning 

36 

0.67 

3.41 

computers 

Usinff 

32 

-0.19 

2.31 

66 

1.19 

Friends 

Learning 

36 

0.86 

1.18 

UsinK 

32 

0.31 

1.55 

66 

1.33 

Family 

Learning 

36 

1.47 

2.17 

Usins 

32 

1.93 

2.01 

66 

0.87 

library  users 

Learning 

36 

0.72 

2.46 

Usinfc 

32 

0.53 

1.84 

66 

0.18 

People  against 

Learning 

36 

2.25 

4.08 

technoloffv 

UsinK 

32 

1.59 

2.59 

66 

0.78 

People  who 

Learning 

35 

2.42 

3.53 

feel  threatened 

Using 

32 

1.47 

2.55 

65 

1.25 

by  techmdosy 

When  unipolar  measurement  was  used  there  were  significant  diflfeiences  between  the  groups 
on  three  subjective  norms  (See  Table  3):  professors,  people  against  technology  and  people  who 
feel  dueatened  by  technology.  The  learning  group  was  significandy  more  likely  to  believe  that  they 
would  be  influenced  by  what  tiieir  professors  wanted  them  to  do.  With  people  against  technology 
and  people  who  feel  threatened  by  technology  the  using  group  was  significandy  more  likely  to  be 
motivated  not  to  comply. 

Table  3.  T  values  and  means  for  estimates  of  subjective  norms  using  unipolar 
motivation  to  comply 


Referents 

GrouD 

n 

M 

SD 

df 

t 

Professors 

Leaming 

36 

13.72 

4.99 

UsinK 

32 

10.38 

5.66 

66 

2.59* 

Future 

Leaming 

36 

14.00 

5.91 

emplovers 

UsinK 

32 

11.91 

5.95 

66 

1.4  J 

People  who  use 

Leaming 

36 

9.67 

5.07 

computers 

Usins 

32 

7.81 

4.34 

66 

1.61 

Friends 

Leaming 

36 

5.08 

4.35 

UsinK 

32 

3.69 

4.35 

66 

1.18 

Family 

Leaming 

36 

6.25 

6.44 

UsinK 

32 

5.03 

5.37 

66 

0.84 

Libiary  users 

Leaming 

36 

4.28 

5.79 

UsinK 

32 

4.00 

5.35 

66 

0.20 

People  against 

Leaming 

36 

-2.36 

3.79 

technoloKv 

UsinK 

32 

-4.28 

4.31 

66 

2.01* 

People  who 

Learning 

35 

-1.74 

3.24 

fed  threatened 

Using 

32 

-3.91 

4.25 

65 

2.33* 

by  technoloKY 
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The  sum  of  all  normative  beliefs  times  motivations  to  comply  using  unipolar  scaling  also 
showed  significant  differences  between  the  two  groups  (See  Table  4).  The  learning  group  was 
significantly  more  likely  to  comply  widi  normative  referents. 

Table  4.  T  values  and  means  for  sums  of  all  subjective  norms. 


Subjective 


Norm 

Group 

n 

M 

SD 

df 

t 

Bipolar 

Learning 

36 

16.44 

15.35 

Using 

32 

11.13 

9.04 

66 

1.71 

Unipolar 

Learning 

36 

49.00 

22.69 

Usinx 

32 

34.63 

23.18 

66 

2.58* 

*p<.05 

In  this  study  moic  significant  differences  resulted  when  the  measurement  was  unipolar.  The 
implications  of  these  results  are  unclear.  Other  researchers  have  found  significant  correlations  widi 
normative  beliefs  and  motivations  to  comply  measured  bipolarly  (Hom,  1979),  witii  botii  measured 
unipolarly  (Davidson  &  Jaccard,  1979)  and  with  nonnative  beliefs  measured  bipolarly  and 
motivation  to  comply  measure  unipolaily  (Hshbein  &  Ajzen,  1981).  Hie  contrcn^ersy  in  this  area 
is  strong  and  unresolved  Fishbein  and  Ajzen's  (1981)  recommendations  are  to  use  unipolar 
measurement  for  motivaticms  at  the  general  level  and  bipolar  measurement  for  motivations  at  die 
behavioral  domain  level 

Subjective  norms  are  still  problematic  in  using  the  Fishbein  Model  for  predicting  and 
understanding  behavior.  In  diis  study  students  in  die  learning  to  use  microcomputers  group  tended 
to  be  more  stnmg^y  motivated  to  comply.  One  possible  inteipretation  would  be  the  action  of 
learning  created  a  need  to  conq)ly .  The  controversy  surrounding  the  motivation  to  comply 
construct,  however,  reduces  die  ability  to  make  generalizations.  It  is  an  issue  which  requires 
furdier  investigation.  Researchers  in  education  need  to  be  aware  of  die  problems.  Qear  definition 
of  behavioral  domains  and  measurement  techniques  is  critical  to  understanding  nonnative 
influences  when  using  die  Fishbein  Model. 

Recommendations  for  Applying  die  FishbeLi  Model 

Applying  the  Fishbein  Model  in  educational  contexts  has  advantages  and  disadvantages. 
Characteristics  of  die  normative  referents  and  measurement  issues  affect  bodi  prediction  and 
understanding.  Normative  referents  positive  or  negative  characteristics  should  be  evaluated  when 
constructing  questionnaires  and  analyzing  responses.  Measurement  scales  for  motivation  i  :> 
comply  need  to  ccxisider  specificity  of  domain  level  and  context.  The  Fishbein  Model  can  be  a 
usefbl  tool  for  examining  normative  influences  and  behavior  in  education  if  it  is  applied  and 
interpreted  appropriately. 
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Abstract 

The  purpose  of  this  study  was  to  examine  the  effects  of  instruction  that  is  organized  in 
two  alternative  formats  -  hierarchical  (Gagne,  1%2)  and  elaborated  (Reigeluth,  1979)  - 
-  on  learners'  recall  and  application  of  content-spedfic  principles.  Sixty-nine  college 
juniors  and  seniors  enrolled  in  an  educational  media  production  course  studied  one 
of  two  versions  of  instrurtional  text  dealing  with  photography-related  principles.  One 
version  was  organized  using  learning  hierarchy  prescriptions;  the  other  using 
elaboration  theory  prescriptions.  No  statistically  significant  differences  were  found 
between  the  two  treatment  groups.  However,  the  hierarchical  version  of  the 
materials  was  considerably  shorter  and  took  less  time  to  complete,  thus  raising 
questions  about  the  efficiency  and  cost-effectiveness  of  instruction  designed  following 
elaboration  theory  prescriptions. 
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An  Examination  of  Two  Approaches 
to  Organizing  Instruction 

Traditional  models  of  instructional  design  most  frequently  have  used  learning 
hierarchies  (Gagne,  1962)  as  the  basis  for  organizing  and  sequencing  instruction. 
Reigeluth  (1979)  criticized  such  an  approach  for  creating  instruction  that  is  "highly 
fragmented/'  "demotivating/*  and  "inconsistent  with  much  knowledge  about  how 
learning  occurs  most  effectively."  (p.  8).  Reigeluth  argued  that  instruction  will  be 
more  effective  if  organized  using  elaboration  theory  as  a  guide.  The  purpose  of  this 
study  was  to  examine  the  effects  of  instruction  that  is  organized  in  two  alternative 
formats  -  hierarchical  and  elaborated  -  on  learners*  recall  and  application  of  content- 
specific  principles.  Secondarily,  the  study  investigated  whether  these  organizational 
formats  are  differentially  effective  for  learners  with  particular  cognitive  styles. 

Overview  of  Organizational  Alternatives 

When  instruction  is  designed  using  learning  hierarchy  prescriptions,  the 
designer  first  analyzes  the  instructional  goal  by  breaking  the  goal  down  into  its 
information  processing  components.  Prerequisite  skills  and  knowledge  are  then 
identified.  When  completed,  such  an  analysis  presents  a  hierarchy  of  skills  and 
knowledge  indicating  what  a  learner  must  know  before  beginning  instruction  on  the 
next  skill  or  topic.  Thus  the  organization  and  sequence  of  instruction  is  dictated  by 
the  prerequisite  relationships  of  skills  and  knowledge  identified  in  the  hierarchy.  As 
suggested  in  Figure  1,  following  this  approach,  instruction  is  usually  sequenced  in  a 
parts-to-whole  (bottom-to-top)  and  first-to-last  (left-to-right)  manner.  Instruction 
organized  according  to  learning  hierarchy  prescriptions  is  purported  i..  be  effective 
(because  students  learn  everything  they  need  to  know  in  order  to  move  on  to  the  next 
higher  skill)  and  efficient  (because  extraneous  information  is  eliminated). 

Figure  1.  Graphic  representation  of  learning  hierarchy  sequence. 
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 > 

Part  2 

Part  3 

 > 
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18  /# 
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Italic  numbers  indicate  sequence  of  instniction. 
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When  instruction  is  designed  following  elaboration  theory  prescriptions,  the 
designer  first  selects  the  type  of  organizing  s*^^cture  —  conceptud,  procedural,  or 
theoretical  -  that  will  be  the  basis  for  the  im  ti  ^ction.  Next,  this  organizing  structure 
is  developed;  all  important  concepts,  procedures,  or  principles  are  idw;ntified.  The 
content  is  then  allocated  to  "levels  of  elaboration"  with  the  simplest,  most 
fundamental  content  in  an  "epitome"  (Reigeluth  &  Stein,  1983).  An  epitome  is  a 
introductory  experience  which  presents  the  simplest  content  and  provides  the  learner 
the  opportunity  to  apply  this  content.  More  complex  content  is  allocated  to 
subsequent  levels  of  elaboration.  As  indicated  in  Figure  2,  the  sequence  of  instruction 
is  suggested  by  a  general-to-specific,  simple-to-complex  (top-to-bottom)  organization. 
Instruction  organized  according  to  elaboration  theory  prescriptions  is  purported  to  be 
effective  and  efficient  (because  new  content  is  presented  within  the  context  of  already- 
known  content)  and  appealing  (because  the  learner  is  aware  of  the  overall  context  and 
the  relationships  among  content  elements). 

Figure  2.  Graphic  representation  of  elaborated  sequence. 


Topic  XY 


*  Italic  numbers  indicate  sequence  of  instruction. 


In  addition  to  the  simple-to-complex  sequence  and  single  type  of  organizing 
content,  elaboration  theory  consists  of  five  other  instructional  strategy  components: 

•  summarizers 

•  synthesizers 

•  analogies 

•  learner  control  options  (where  appropriate) 

•  learning  prerequisites  (where  needed). 

An  in-depth  discussion  of  these  strategy  components  can  be  found  in  Reigeluth  and 
Stein  (1983). 


654 


Organizing  Instruction 

4 


The  research  on  elaboration  theory  is  somewhat  limited.  This  can,  in  part,  be 
traced  to  the  fact  that  elaboration  theory  is  purported  to  be  most  effective  for 
instruction  involving  several  lessons  dealing  with  several  interrelated  topics 
(Reigeluth,  1979)  Thus,  limited-scope  research  efforts  (e.g.,  studies  of  single-concept 
learning  or  simple-procedure  learning)  are  not  appropriate  when  studying 
elaboration  theory.  The  hypothesized  advantages  of  elaboration  theory  will  be 
realized  only  if  the  content  is  of  sufficient  amount  and  complexity  that  the 
interrelationships  among  content  elements  become  important  to  the  learning  task. 

Given  the  complexity  of  elaboration  theory  and  learning  hierarchical 
prescriptions,  it  is  evident  that  no  single  study  can  adequately  address  all  the  relevant 
issues.  A  research  agenda  (Smith  &  Wedman,  1986)  was  developed  to  systematically 
examine  the  approaches  and  their  effects  on  learning  outcomes.  The  following 
questions  were  taken  from  that  agenda  and  addressed  in  this  research: 
What  is  the  relative  effectiveness  of  hierarchically-based  versus  elaborated  instruction 
in  learning  content-related  principles?  Are  these  two  forms  differentially  effective 
across  levels  of  field  independence/dependence? 

In  particular  the  study  sought  to  compare  the  effects  of  materials  designed  and 
organized  with  selected  elaboration  ttieory  techniques  to  instruction  solely  organized 
using  a  learning  hierarchy.  It  was  hypothesized  that  instruction  organized  following 
selected  elaborative  techniques,  prefaced  with  an  epitome  (thus  aeating  a  general-to- 
specific  sequence)  and  rewritten  to  include  end-of-lesson  and  end-of-set  (i.e.,  end  of 
instructional  unit)  synthesizers,  would  produce  superior  learning  to  instruction 
solely  following  learning  hierarchy  presaiptions. 

The  research  also  attempted  to  identify  any  interaction  between  instructional 
organization  and  the  cognitive  style  variable  -  field  dependence/independence.  Field 
independent  learners  tend  to  do  well  on  cognitive  tasks  that  require  structuring  and 
reorganizing  content;  field  dependent  learners  have  more  difficulty  with  such  tasks 
(Witkin,  Moore,  Goodenough  &  Cox,  1977).  Given  Reigeluth's  charge  that  content 
organized  following  learning  hierarchy  presaiptions  is  "highly  fragmented,"  it  was 
hypothesized  that  the  hierarchically  organized  instruction  would  be  less  effective  for 
field  dependent  learners  than  the  elaborated  design  because  they  would  have  more 
difficulty  integrating  the  individual  skills  into  integrated  knowledge. 

Methods 

The  subjects  for  this  study  were  junior  and  senior  students  enrolled  in  two 
sections  of  an  instructional  media  production  course  at  a  large  midwestern 
university.  Two  sets  of  materials  dealing  with  photography  content  were  used  in  the 
study;  both  sets  were  designed  to  teach  the  temunal  obje^  tive.  The  first  set  of 
materials  was  designed  following  learning  hierarchy  instructional  prescriptions.  The 
materials  were  then  redesigned  following  selected  elaboration  theory  prescriptions 
(an  epitome  and  end-of-lesson  and  end-of-unit  synthesizers)  thus  creating  the  second 
set  of  materials. 


ERIC 


655 

S43 


Organizing  Instruction 

5 

The  learning  hierarchy  version  consisted  of  72  pages  of  instruaional  text 
organized  into  four  lessons.  The  elaborated  version  consisted  of  138  pages  of 
instructional  text  organized  into  six  lessons,  the  first  being  the  epitome.  The  epitome 
required  the  subjects  to  make  non-numerical  predictions  using  principles  related  to 
photographic  exposure  and  image  clarity  (e.g..  If  the  shutter  speed  is  increased,  the 
aperture  size  must  be  made  larger  to  get  an  equivalent  exposure). 

Four  assessment  instruments  were  used  in  the  study.  The  Hidden  Figures  Test 
(i^Yench,  Ekstrom,  &  Price,  1963)  was  used  to  measure  the  subjects  along  the  field 
dependence/independence  dimension.  A  12-point  pretest  that  assessed  p)erformance 
on  direct  application  tasks  was  used  to  assess  prior  knowledge  of  the  content.  A  14- 
poiiit  posttest  and  delayed  posttest  was  used  to  assess  mastery  of  the  content  on  the 
application  level.  The  delayed  posttest  was  patterned  after  the  posttest  but  item 
specifics  were  changed  to  minimize  item  familiarity. 

During  the  first  week  of  the  semester,  the  pretest  and  the  Hidden  Figures  Test 
(HFT)  were  administered.  Four  weeks  after  the  pretesting  session,  the  subjects  were 
randomly  assigned  (by  coin  flip)  to  study  either  the  hierarchical  or  elaborated  versions 
of  the  instructional  materials.  All  studying  was  done  during  the  regularly  scheduled 
class  time;  a  total  of  three  hours  was  available  for  study.  The  subjects  recorded  the 
amount  of  time  they  studied  the  materials.  The  posttest  was  given  whenever  an 
individual  indicated  that  he/she  was  ready.  One  week  later,  the  subjects  were  given 
an  unannounced  delayed  posttest. 

Results 

Pretest  lesults  indicated  that,  with  few  exceptions,  the  subjects  were  complete 
novices  in  terms  of  the  photographic  content  used  in  the  study.  Table  1  shows  the 
descriptive  statistics  for  the  pretest,  posttest,  delayed  posttest,  and  Hidden  Figures  Test 
results  for  each  treatment  group. 


Table  1.  Mean  Test  Scores  for  Treatment  Groups  bv  Version 


Test 

Version 

Mean 

S.D. 

Range 

N 

Pre 

Elaborated 

0.58 

0.96 

0-3 

31 

Hierarchical 

0.52 

0.98 

0-4 

38 

Post 

Elaborated 

6.32 

2.78 

1-11 

31 

Hierarchical 

6.89 

3.10 

2-13 

38 

Delayed 

Elaborated 

5.80 

2.87 

0-12 

31 

Hierarchical 

6.89 

2.84 

1-12 

38 

HFT 

Elaborated 

10.87 

7.07 

2-26 

31 

Hierarchical 

8.34 

3.99 

2-17 
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The  average  study  time  for  the  elaborated  materials  was  114  minutes  compared 
to  88  minutes  for  the  hierarchical  materials.  This  was  inconsistent  with  pilot  test 
results  wb"  li  had  indicated  approximately  equal  times  for  each  each  version  of  the 
materials. 

Using  the  General  Linear  Model  in  SAS  (1985),  a  two-way  ANOVA  was 
conducted  to  test  the  following  L/potheses: 

1)  there  would  be  no  statistically  significant  difference  between  the  two  treatment 
groups'  scores  on  either  the  posltest  or  the  delayed  posttest. 

2)  there  would  be  no  statistically  significant  difference  betweer\  field  dependent  and 
field  independent  learners'  scores  on  eithc  the  posttest  or  the  delaved  posttp'^t. 

3)  there  would  be  no  statistically  significant  interaction  between  treatment  ai. '  tield 
dependence/  independence. 

Tables  2  and  3  present  a  summary  of  these  analysis. 

Table  2.  Analysis  of  Variance:  Posttest 


Source 

SS 

df 

F 

PR>F 

Treatment 

5.314 

1 

0.60 

.441 

n/FD 

13.608 

1 

1.54 

.219 

Interaction 

0.098 

1 

0.01 

.916 

Table  3.  Analvsis  of  Variance:  Delayed  Posttest 


Source 

SS 

df 

F 

PR>F 

Treatment 

19.734 

1 

2.40 

.126 

n/FD 

11.696 

1 

1.42 

.237 

Interaction 

.'.098 

1 

0.16 

.694 

In  the  first  statistical  hypothesis,  the  posttest  and  delayed  posttest  scores  of  the 
hierarchical  group  were  compared  to  the  posttest  and  delayed  posttest  scores  of  the 
elaboration  group.  For  the  posttest  scores,  an  F  value  of  0.60  resulted  from  the 
analysis,  with  a  probability  ratio  of  .441.  For  the  delayed  posttest  scores,  an  F  value  of 
2.40  resulted  from  the  analysis,  with  a  probability  ratio  of  .126.  Thus,  no  stadstically 
significant  difference  v/as  found  betw^  a  the  two  treatment  groups'  scores  on  either 
the  posttest  and  or  the  delayed  postte* 

To  test  the  second  hypothesis,  posttest  and  delayed  posttest  scores  of  the  field 
dependent  group  were  compared  to  the  posttest  and  delayed  posttest  scores  of  the  field 
independexS  group.  For  the  posttest  scores,  an  F  value  of  1.54  with  a  probability  ratio 
of  .219  was  obtained.  For  the  delayed  posttest  scores,  an  F  value  of  1.42  with  a 
probability  ratio  of  .237  was  obtained.  Thus,  no  statistically  significant  difference  was 
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found  between  the  field  dependent  and  field  independent  groups'  scores  on  the 
posttest  and  delayed  posttest. 

The  third  analysis  was  conducted  to  check  for  an  interaction  between  treatment 
and  field  dependence/independence  for  posttest  and  delayed  posttest  scores.  For  the 
posttest  scores,  an  F  value  of  .01  was  calculated  with  a  probability  ratio  of  .91675.  For 
the  delayed  posttest  scores,  an  F  value  of  .16  was  calculated  with  a  probability  ratio  of 
.694.  Thus,  no  statistically  significant  interaction  between  treatment  and  field 
dependence/ independence  v/as  found.  (Note;  Similar  tests  were  run  using  extreme 
scores  (top  quartile/bottom  quartile)  on  the  Hidden  Figures  Tests.  No  significant 
interactions  were  found.) 

Discussion 

The  results  of  this  study  did  not  support  the  prediction  that  students  receiving 
instn-  •lion  following  elaboration  techniques  would  outperform  studer  5  receiving 
instruction  foiiowing  strict  learning  hierarchy  prescriptions.  Statistical  analy<^is  of  test 
bcores  indicated  no  significant  difference  between  the  elaborated  and  hierarchical 
treatment  groups.  Such  a  finding  is  contrary  to  Reigeluth*s  prediction  that  elaborated 
instruTi.on  will  produce  more  stable  cognitive  structures,  thus  improving  long  term 
rtrention.  The  researcl'i  findings  are  discussed  below,  first  in  terms  of  future  research 
and  then  in  terms  of  implications  for  instructional  design  practice. 

Elaboration  theory  was  developed  as  a  macro-level  approach  to  organizing 
instruction,  that  is,  sequencing  instruction  dealing  with  several  interrelated  topics. 
This  instruction  was  a  multi-topic,  1  and  1/2  to  2  hour  unit  involving  application  of 
several  complex,  interrelated  principles.  It  was  expected  that  the  benefits  of  the 
integrating  potential  of  elaborated  instruction  would  be  detectable  In  such  a  situation, 
especially  with  learners  of  such  low  levels  of  prior  knowledge.  It  is  ix>ssible  thai  the 
content  used  in  the  study  was  still  not  of  sufficient  amount  and/or  complexity  for  the 
purported  advantages  to  be  realized.  Further  investigation  with  larger  amounts  of 
complex  content  may  provide  support  for  elaboration  theory  presaiptions  and  help 
answer  the  question  of  when  to  use  the  prescriptions. 

The  subjects*  perceptions  of  th"  learning  task  and  materials  may  have 
influenced  their  performance  on  the  posttests.  Subjects  working  with  the  elaborated 
materials  first  studied  the  epitome,  which  presented  the  content  in  a  general  manner 
without  mention  of  numerical  relationships,  and  then  studied  a  more  detailed 
treatment  of  the  content.  Subjects  working  with  the  hierarchical  materials  were 
presented  with  only  the  detailed  content.  It  is  possi.  le  thai  the  elaborated  treatment 
group  retained  the  general  relationships  and  lended  to  dismiss  the  numerical 
specifics.  Future  research  might  assess  learners*  abilit^/  to  apply  the  principles  in  both 
general  and  numerical  applications  to  determine  if  the  two  sets  of  materials  are 
differentially  effect  at  these  two  levels. 
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Students'  performance  was  surprisingly  low  for  both  groups  with  means  of  6.32 
and  6.89  (on  a  14  point  scale)  for  the  elaborated  and  hierarchical,  respectively,  on  the 
immediate  posttest  and  5.80  and  6.89  (on  a  14  point  scale),  respectively,  on  the  delayed 
posttest.  The  materials  were  developed  to  have  a  high  conceptual  density  iu  order  to 
heighten  the  need  for  integration  of  information.  However,  the  conceptual  load  may 
have  been  so  high  that  students  became  overwhelmed  and  undermotivated.  Further 
research  with  these  same  materials  may  utilize  several  sessions  in  order  to  avoid  this 
potential  problem. 

The  failure  to  identify  ai\  interaction  between  the  tisatment  variable  and  field 
dependence /independence  does  not  rule  out  the  possibility  that  learner  variables 
might  have  confounded  the  research  findings.  Cell  sizes  were  rather  small  to  detect 
such  interactions.  Future  research  involving  larger  samples  or  other  measures  and 
dimensions  of  cognitive  style  might  reveal  stable  relationships  which  could  be 
incorporated  into  elaboration  theory  or  learning  hierarchy  prescriptions 

In  spite  of  the  failure  to  find    significant  difference  that  could  be  attributed  to 
instructional  treatment,  this  study  has  implications  for  instructional  design  practice, 
at  least  when  dealing  with  a  few  interrelated  principles.  The  presence  of  the  epitome 
lesson  and  the  end-of-lesson  and  end-of-set  synthesizers  made  the  elaborated 
materials  approximately  50%  longer  than  the  hierarchical  materials  (108  pages  versus 
72  pages).  Thus,  if  materials'  cost  is  an  issue,  designers  might  opt  for  a  hierarchical 
organization  because  of  reduced  production /duplication  costs.  The  extra  length  of  the 
materials  was  directly  related  to  the  amount  of  time  the  subjects  look  to  complete  the 
material,  an  average  of  114  minutes  for  the  elaborated  version  versus  88  minutes  for 
the  hierarchical.  (And,  interestingly,  the  increased  time  on  task  did  not  bolster  the 
performance  of  the  students  interacting  with  the  elaborated  version.)  Thus,  if 
learning  efficiency  is  an  issue,  designers  might  again  opt  for  a  hierarchical 
organization. 

Conclusion 

The  results  of  this  study  offers  no  support  for  the  use  of  elaboration  theory 
prescriptions  when  designing  instruction  dealing  with  a  few  interrelated  principles. 
Three  conclusions  stand  oul  The  generai-to-detailed  sequence  and  periodic 
synthesizers  resulted  in  materials  that  were:  1)  n.ore  expensive,  2)  less  efficient,  and 
3)  no  more  effective  than  nwterials  designed  following  learning  hierarchical 
prescriptions.  Perhaps  future  research  dealing  with  larger  amounts  of  content  will 
provide  evidence  to  the  contrary. 
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statement  of  the  Problem 


In  1962,  Gagne  introduced  the  learning  hierarchy  model  as  a 
theory  of  knowledge  acquisition.     He  suggested  that  a  skill  couid 
not  be  acquired  unless  the  learners  possessed  certain 
prerequisite  skills,  which  were  identified  by  asking  the  question 
"What  would  the  individual  have  to  be  able  to  do  in  order  that  tie 
can  attain  successful  performance  on  this  task,  provided  that  he 
is  gWen  only  instructions?"  (p. 358).     The  same  question  was  then 
applied  to  each  prerequisite  skill.     As  a  result,  a  hierarchy 
could  be  derived. 

In  the  same  article,  Gagne  proposed  that  the  learning 
hierarchy  theory  had  two  hypotheses:  "a)  no  individual  could 
perform  the  final  task  without  having  these  subordinate 
capabilities...;  and  b)  that  any  superordinate  task  in  the 
hierarchy  could  be  performed  by  an  individual  provided  suitable 
instructions  were  given,  and  provided  the  relevant  subordinate 
knowledge  could  be  recalled  by  him"   (p.  356). 

Although  Gagne  (personal  communication,  January,  1988) 
argued  that  the  fourth  edition  of  his  book  The  Conditions  of 
Learning  (1985)  provided  a  more  updated  and  refined  account  ot 
the  hierarchy  theory,  a  close  examination  indicated  that  the 
fundamental  points  remained  the  same  (Yao,  1989). 

In  1968  Gagnp  published  another  important  article  about  the 
learning  hierarchy.     In  this  article,  he  pointed  out. that  a 
learning  hierarchy  could  not  represent  a  unique  or  most  efficient 
route  for  any  given  learner.     Instead,  what  it  represents  is  the 
most  probable  expectations  of  greatest  positive  transfer  for  an 
entire  sample  of  learners.     An  individual  learner  does  not 
necessarily  have  to  acquire  each  subordinate  skill  precisely  in 
hierarchical  sequence  in  order  for  him  to  learn  the  final  task. 

He  further  explained  that  nothing  in  the  analysis  method 
which  derives  the  hierarchies  told  us  about  the  capabilities  of 
the  individual  learners.     Therefore,  he  stated  that  "a  qiven 
individual  may  be  ablp  to  'skio'  one  or  more  of  the  subordinate 
tasks,   just  as  a  given  learner  may  be  able  to  'skip'  parts  of  an 
adaptive  program  of  instruction  [p. 3  (Gagne,  1968)]." 

However,  this  important  point  has  been  ignored  by  most 
people  since  it  was  first  addressed  by  Gagne.     Many  learning 
hierarchies  researchers  have  focused  their  investigations  on 
testing  the  validity  of  hierarchies,     k  review  of  the  literature 
on  learning  hierarchies  has  revealed  that  the  skipping  of 
subordinate  skills  has  never  been  studied  (Yao,  1989). 
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Focus  of  the  Study 

The  purpose  of  this  study  was  to  investigate  the  following 
two  issues: 

1.  Can  some  learners  skip? 

2.  What  are  the  factors  that  influence  a  given 
individual's  potential  for  skipping? 


Skipping  in  this  study  is  defined  as  1)  from  instructional 
perspective,  a  situation  where  instruction  on  one  or  more  skills 
in  a  learning  hierarchy  is  omitted,  and  2)   from  the  learner's 
perspective,  the  capability  to  obtain  on  one's  own  the  skills 
that  are  omitted  from  instruction  and  the  superordinate  skill  to 
those  skills. 


The  hypotheses  and  questions  this  study  attempted  to  examine 
included: 

1.  Some  learners  can  skip  one  or  more  subordinate  skills 
of  a  given  hierarchy  and  still  achieve  the  terminal 
objectives . 

2.  The  extent  to  which  a  learner  can  skip  depends  on  1) 
the  individual's  content-related  ability  and  2)  the 
skipping  size,  defined  aj  the  number  of  skills 
skipped. 


2.1  Learners  perform  less  well  when  the  skipping  size 
is  large  or  when  more  skills  are  skipped, 

2.2  Higher-ability  learners  perform  better  than 
lower-ability  learners  on  the  skipped  skill(s)  and 
on  the  superordinate  one(s). 


The  Hierarchy 


This  study  requires  the  use  of  a  learning  hierarchy  that  has 
already  been  validated,     A  hierarchy  of  kinematics  (see  Figure  1 
and  Table  1)  was  chosen  because  it  has  been  validated  by  White 
(1974),  White  and  Gagne  (1978),  and  Dick  (1980),  and  has  been 
used  in  2  other  studies  (Kee  &  White,   1979;  Trembath  &  White, 
1978-79)  , 
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Figure  1 
The  Original  Hierarchy 


13 


11 


(*  eliminated) 

Figure  2 
The  Revised  Hierarchy 


However,  a  few  modifications  were  made  in  the  hierarchy 
actually  used  in  the  experiment  (see  Figure  2  and  Table  1): 

1.  Skill  #2  in  the  original  hierarchy  was  broken  down  into 
2  skills  (#2  and  #3)  in  the  revised  hierarchy. 

2.  Skill  #7,   #8,  and  #9  in  the  original  hierarchy  were 
eliminated  from  the  actual  hierarchy  because  they  have 
boen  invalidated  in  all  of  the  3  validation  studies 
mentioned  above.     The  explanations  offered  by  the 
researchers  was  that  these  elements  are  in  the  domain 
of  verbal  knowledge,  not  of  intellectual  skills,  to 
which  learning  hierarchies  apply. 

These  three  elements  define  the  slope  of  a  line  on  a 
position-time  graph  as  the  speed  of  the  movement 
represented  by  that  line.     By  eliminating  these 
elements,  students  would  be  given  the  formulae  to 
calculate  the  speed  directly  without  involving  the 
slope  at  all . 

3.  Skill  #11  in  the  original  hierarchy  was  eliminated  in 
the  revised  hierarchy  in  order  to  simplify  the 
treatment  and  to  have  better  control  of  the  experiment. 
Skill  #11  deals  with  the  unit  of  speed-     To  take  care 
of  this  gap,  the  units  were  provided  throughout  the 
instructional  booklet  and  the  posttest. 
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Table  1:  Elements  of  the  Hierarchies 
The  Original  Hierarchy  The  Revised  Hierarchy 


1.  Finds  time  after  start  on  a 
position-time  graph. 


2 .  Calculates  time  interval 
between  two  points  on  a 
pes it ion- time  graphs 

3.  Finds  displacement  from 
st;*^t  on  position  axis  of  a 
posit ion- time  graph • 

4.  Finds  displacement  from 
start  on  a  position-time 
graphs 

5.  Calculates  displacement 
between  two  points  on  a 
position  line. 

6.  Calculates  displacement 
between  two  points  on  a 
position-time  graph. 

1*  States  that  line  with 
biggest  slope  in  position-time 
graph  represents  biggest 
velocity . 

8,  Grades  lines  on  position- 
time  graph  in  order  of 
velocities . 

9,  States  slope  of  position- 
time  graph  is  velocity, 

10,  Calculates  slope  of  line 
given  verticul  and  horizontal 
intercepts . 

11 •  Calculates  slope  of  line 
with  units, 

12.  Calculates  velocity 
represented  by  straight  line  on 
position-time  graph. 


!•  Finds  time  after  start  on  a 
time  line. 

2*  Finds  time  after  start  on  a 
pes it ion- time  graph . 

3,  Calculates  time  interval 
between  two  points  on  a 
position-time  graph . 

4,  Finds  displacement  from 
start  on  a  position  line. 

5 •  Finds  displacement  from 
start  on  a  position- time  graph. 


6 •  Calculates  displacement 
between  two  points  on  a 
position  line, 

7,  Calculates  displacement 
between  two  points  on  a 
posit ion- time  graph . 

8.  (eliminated) 


9 .  (eliminated) 


10 •   (eliminated ) 

11*  Calculates  slope  of  line 
given  displacement  and  time 
interval . 

12 .  (eliminated) 

13.  Calculates  speed 
represented  by  straight  line  on 
a  position-time  graph. 
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Pilot  Study 

After  the  hierarchy  was  chosen,  a  pilot  study  was  conducted 
in  order  to: 

*  improve  the  experimental  instruments. 

*  select  the  appropriate  grade  level{s)  for  this 
particular  hierarchy. 

*  find  out  the  amount  of  time  needed  for  the  treatment. 

Forty-five  students  from  grades  5,  6,  1,  and  8  participated 
in  the  pilot  study,  in  which  the  7th  and  8th  graders  took  only 
the  pretest,  and  the  5th  and  6th  graders  took  the  pretest  and 
read  the  instructional  booklet.     The  results  of  the  pilot  study 
showed  that: 

*  most  of  the  Jth  and  8th  graders  and  a  few  5th  and  6th 
graders  had  mastered  all  the  skills  in  the  hierarchy. 

*  most  of  the  5th  and  6th  graders  had  mastered  the  basic 
skills  (i.e.,  subtraction  and  division)  necessary  for 
the  learning  of  the  skills  in  the  hierarchy. 

Based  on  the  results  of  the  pilot  study,  the  5th  and  6th 
grades  were  chosen  as  the  appropriate  grade  level  for  the 
experiment . 


Experimental  Materials 

The  instruments  in  this  study  included: 

1,  A  pretest,  which  tested  the  subjects  on  subtraction  (5 
items),  division  (5  items),   skill  #1  (2  items),  skill 
#2   (6  items),   skill  #3  (3  items),  skill  #4  (2  items), 
skill  #5  (6  items),  skill  #6  (2  items),  and  skill  #7  (3 
items ) • 

2,  An  instructional  booklet,  which  taught  subjects  all 
the  skills  but  the  one(s)  they  were  supposed  to  skip 
accoiTding  to  the  treatment  they  wei.e  assigned  into. 
For  each  skill  that  was  taught,  instructions  were 
presented  followed  by  practice  items  and,  then, 
feedback  (i.e.,  the  correct  answer  and  solution  to  the 
problem).     For  the  skill  that  was  to  be  skipped,  two 
questions  were  presented,  but  no  feedback  was  given. 
Subjects  were  only  asked  to  solve  the  problem  on  their 
own . 

3,  A  post  test,  which  tested  subjects  on  skills  #2,   #3,  #5, 
#7,  #11,  and  #13  (5  items  for  each  skill). 
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Procedure 

One  hundred  and  seventy-three  (173)  5th  and  6th  grade 
students  participated  in  the  experiment.    Among  them,  93  were  in 
6th  grade  and  80  were  in  5th  grade.     Mathematics  scores  from  the 
California  Achievement  Test  (CAT)  were  obtained  for  each 
participant,  which  included  computation,  concept  &  application, 
and  tot  .il  grade  equivalent  scores. 

All  173  subjects  took  the  pretest  one  week  prior  to  the 
treatment.     Based  on  the  pretest  results,  a  profile  of  the  entry 
level  performance  was  obtained  for  each  subject.     This  profile 
contained  the  pass/fail  pattern  for  each  skill  tested  in  the 
pretest.     Table  2  lists  the  patterns  for  skills  #2,  #3,   #5,  and 
#7,  which  were  particularly  critical  to      e  experiment. 

Out  of  these  173  participants,   32  (24  in  6th  grade  and  8  in 
5th  grade)  had  possessed  all  the  skills  in  the  hierarchy.  Their 
data  were  excluded  from  final  analysis.     This  left  141  subjects 
whose  data  were  to  be  used. 

Based  on  the  math  total  grade  equivalent  scores  from  CAT, 
these  141  subjects  (5th  and  6th  graders  combined)  were  divided 
into  2  groups:  higher  and  lower  ability.     The  scores  ranged  from 
2.8  to  12.0  and  the  median  score  for  the  entire  group  (5.9)  was 
used  as  the  cutting  point  to  divide  the  groups.     The  resulting 
mea  s  of  the  math  total  scores  for  the  higher-ability  group  was 
7.44   (n  =  69)  and  for  the  lowet -abi lity  group  was  4.92  (n  =  72). 

Based  on  subjects'  entry  level  profile,  each  of  the  141 
individuals  was  further  assigned  into  one  of  four  treatment 
groups.     The  rule  for  the  assignment  was:  a  subject  could  not  be 
assigned  into  a  treatment  which  was  going  to  skip  the  skill (s) 
he/she  already  possessed. 

The  treatment  lasted  for  2  days,   1  class  session  on  each 
day.     On  Day  1,   subjects  read  Part  1  of  the  instructional 
booklet.     On  Day  2,  they  finished  Part  2  of  the  booklet  and  then 
took  a  posttest. 


Research  Design 

A  4  X  2  factorial  design  was  used.     Four  levels  of  skipping 
treatment  were  crossed  with  two  levels  of  mathematics  ability 
; higher  and  lower).     The  four  treatments  included: 


* 


* 


Treatment  1 
Treatment  2 
Treatment  3 
Treatment  4 


skipped  skills  #3  and  #7 
skipped  skill  #3 
skipped  skills  #2  and  #3 
skipped  none  (control  group) 
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Seven  dependent  measures  were  used.    These  measures  came 
from  individual  scores  for  the  six  skills  tested  in  the  posttest 
(#2,   #3,   #5,   #7,  #11,  and  #13)  and  a  total  score  by  adding  these 
six  scores  together. 


Table  2: 

Pass/Fail  Patterns  for  Skills  #2,   #3,  #5,  &  #7  in  Pretest 


Skill  Available 


Pattern 

#2 

#3 

#5  #7 

# 

of  Ss 

Treatments 

a . 

+ 

+  + 

32 

none 

b. 

- 

1 

T4 

c . 

+  + 

5 

T2,T4 

d. 

+ 

+ 

+ 

2 

T4 

e . 

7 

T4 

f . 

- 

+ 

1 

T4 

g- 

- 

+ 

15 

T1,T2,T4 

h. 

+ 

+ 

1 

T4, 

i  . 

+  + 

29 

T2,T3,T4 

j  . 

+ 

10 

T4 

k. 

+ 

7 

T1,T2,T4 

1. 

+ 

13 

T1,T2,T3,T4 

m . 

+ 

7 

T4 

n . 

+ 

2 

T2,T3,T4 

o . 

41 

T1,T2,T3,T4 

Total : 

173 

(   +  :  Pass; 

-   :  Fail) 

Tl: 
T2: 
T3: 

skipped 
skipped 
skipped 

skills  #3  and 
skill  #3 
skills  #2  and 

#7 
#3 

T4:  skipped  none 


669 


8 


Research  Results 

ANOVA's  were  conducted  on  all  of  the  7  dependent  measures. 
A  summary  of  the  results  is  presented  in  the  table  below. 
Whenesrer  significant  differences  occurred,  Scheffe's  post  hoc 
analysis  was  used  for  pairwise  and  complex  comparisons. 


Table  3:  Summary  of  ANOVA  Results 


Variables  Treatment  Ability  2-way  Interaction 


Ski 11- 

•> 

F ( J , 1 J  J ) =2 
p  =  0.069 

.425 

F  (  1 , 1 33 ) =22 
p  =  0.000** 

.  7o4 

F(  3  ,  1  J  J  )  - 1 . 
p  =  0.192 

oU  J 

Skiii- 

J 

F ( J , 1 3 3 ) =4 
p  =  0.007* 

.161 

F( 1 , 133 ) =31 
p  =  0.000** 

.  lo4 

F(  3  ,  1  3  J  )  -z  . 
p  =  0.055 

C  Q  C 

Skill- 

5 

F( 3, 133)=0 
p  =  0.469 

.849 

F( 1, 133)=9. 
p  =  0.003** 

460 

F(3,133)=1. 
p  =  0.262 

348 

Skill- 

7 

F(3,133)=l 
p  =  0. 161 

.745 

F( 1, 133)=14 
p  =  0.000** 

.160 

F(3,133)=1. 
p  =  0.314 

195 

Skill- 

11 

F( 3, 133)=1 
p  =  0. 163 

.735 

F( 1, 133)=18 
p  =  0.000** 

.314 

F(3,133)=0. 
p  =  0.783 

359 

Skill- 

13 

F( 3, 133)=1 
p  =  0.257 

.361 

F( 1, 133)=19 
p  =  0.000** 

.427 

F( 3, 133)=0. 
p  =  0.831 

292 

Total 

F( 3, 133)=1 
p  =  0. 184 

.638 

F(  1,  l33)=-33 
p  =  0.000** 

.841 

F(3, 1331=1. 
p  =  0.332 

148 

*     significant  at  0.01  level 
**  significant  at  0.005  level 


The  results  of  the  ANOVA's  indicated  that  the  ability  effect 
was  highly  significant  (p  <  0.005)  on  all  dependent  measures. 
However,  analyses  showed  no  significant  treatment  effect  on  any 
dependent  measures  except  skill  #3  (p  =  0.007).     K  treatment-by- 
ability  interaction  was  also  found  on  skill  #3  (p  =  0.055). 

Multiple  comparisons  using  the  Scheffe  method  were  conducted 
on  skill  #3  to  identify  which  means  were  significantly  different. 
Results  inaxcated  that  treatment  groups  3  and  4  '-are 
significantly  different  from  each  other  (p  =  0.014),  and  the 
control  group  (treatment  4)  was  different  from  the  other  three 
skipping  groups  combined  (p  =  0.015). 
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Discussion 

The  results  generally  agreed  with  the  hypothesis  that  some 
learners  can  skip,  and  highly  supported  that  a  learner's  ability 
can  influence  his  or  her  performance  in  a  skipping  situation.  In 
this  study,  higher-ability  learners  outperformed^  lower-ability 
learners  on  che  skipped  skills  (#2,  #3,  and  #7)  and  on  the 
superordinate  one  (#13).     Furthermore,  no  skipping  effect  was 
found  on  skills  #2  and  #7,  which  were  skipped  in  treatment  3  and 
treatment  1  respectively,  and  on  the  superordinate  skill  #13.  In 
other  words,  regardless  of  whether  skill  %2  and  skill  #7  were 
skipped,  no  eftect  was  found  on  subjects'  performance  on  these 
r.wo  skills  and  the  superordinate  skill  #13  when  compared  to  the 
non-skipping  group.     This  suggested  that  higher-ability  subjects 
who  did  not  learn  one  of  these  skills  were  able  to  "fill  in  tf.e 

Significant  treatment  effect,  however,  was  found  on  skill 
#3,     This  effect  was  contributed  by  the  mean  differences  between 
treatment  groups  3  and  4,  and  between  the  three  skipping  groups 
combined  and  the  control  group.     That  is,  when  skills  #2  and  #3 
were  skipped  (treatment  3),  subjects  performed  significantly  less 
well  than  the  non-skipping  group  on  skill  #3.     Since  skill  #2  is 
subordinate  to  skill  #3,  this  finding  suggested  that  when  both 
the  subordinate  (#2)  and  its  superordinate  (#3)  skills  were 
skipped  at  the  same  time,  subjects  were  less  able  to  fill  in  the 
gap.     This  applied  to  both  higher-ability  and  lower-ability 
learners . 

Furthermore,  it  should  be  noted  that  although  the  composite 
mean  of  the  three  skipping  groups  differed  significantly  from  the 
non-skipping  group,  no  significant  differences  were  found  when 
treatment  groups  1  and  2  were  individually  compared  to  the 
control  group.     This  may  be  due  to  the  fact  chat  all  three 
skipping  conditions  involved  sk..ll  #3:  treatment  1  skipped  skill 
#3  and  a  coordinate  skill  #7  (horizontal  skipping);   treatment  2 
skipped  skill  #3;  treatment  3  skipped  skill  #3  and  a  subordinate 
skill  #2  (vertical  skipping).     This  finding  suggested  that 
skipping  skill  #3  and  another  skill  directly  related  to  it 
significantly  decreased  subjects'  performance  on  this  skill  when 
compared  to  the  non -skipping  g  oup. 

It  should  also  be  noted  that  larger  skipping  size  did  not 
necessarily  a^roct  subjects'  performance  in  an  equal  manner. 
For  example,  b'-- ,h  treatment  1  and  treatment  3  skipped  two  skills, 
but  only  subjects  in  treatment  3  performed  significantly  less 
well  than  the  non-skipping  group  on  ski.ll  #3.     This  findings 
suggested  that  in  addition  to  the  skipping  size,  the  type  or 
skipping  (e.g.,  horizontal  or  vertical)  way  al      affect  a 
learner's  performance  in  a  skipping  condition. 
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Figure  3:  Treatment-by-ability  Interaction  for  Skill  #3  Scores 


0     I  f.  1  

Htghwr  Ablltly  M»tllty 


Since  a  treatment-by-ability  interaction  existed  on  skill 
#3,  group  means  were  plotted  in  Figure  3,     This  figure 
interestingly  revealed  that  lower-ability  subjects  were  adversely 
affected  irtore  by  the  skipping  condition  in  treatment  1  than  in 
others.     There  was  a  drastic  drop  of  performance  by  lower-ability 
learners  when  both  skills  #3  and  #7  were  skipped.     This  implied 
that  skill  #7,  a  coorc*inate  to  skill  #3,  might        more  critical 
for  lower-ability  learners  to  obtain  skill  #3  than  the 
subordinate  skill  #2,     This  result,  though  ungeneralizable  to 
other  instances  where  different  hierarchies  are  used,  suggested 
that  different  skipping  conditions  variously  affected  lir  arners 
with  different  abilities. 

In  summary,  the  results  of  this  study  supported  the 
hypothesis  that  skipping  one  or  more  subordinate  skills  does  not 
affect  some  learners*  performance  on  the  skipped  skills  and  the 
skill  above  them.     Subjects'  performance  in  a  skipping  condition 
depends  on  the  content  related  ability  of  the  individual,  the 
skipping  size,  and  the  type  of  skipping  (coordinate  or 
subordinate) . 
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Implications  for  Instructional  Design  and  Future  Research 

This  study  offered  come  rough  guidelines  in  prescribing 
instruction  or  learning  assignments  to  learners.  Firstly, 
teachers  and  instructional  designers  may  save  higher-ability 
learners  some  time  by  omitting  instruction  on  certain  skills.  In 
so  doing,   learning  efficiency  for  those  learne.-s  can  be  increased 
without  degrading  their  learning  performance. 

Secondly,  to  facilitate  a  learner's  performance  in  a 
skipping  condition,  selection  of  the  skill(s)  to  be  skipped  can 
be  crucial.     If  more  than  one  skill  is  to  be  skipped,  horizontal 
skipping  (i.e.,   the  skipping  of  a  skill  and  its  coordinate)  may 
result  in  better  performance  than  vertical  skipping  (i.e.,  the 
skipping  of  a  skill  and  its  immediate  subordinate).  This 
guideline,  however,  applies  only  to  higher-ability  learners. 
Results  of  the  study  suggested  that  lower-ability  learners  may 
have  more  trouble  in  a  horizontal  skipping  condition. 

Those  two  guidelines  should  be  used  with  caution.     This  is 
because  the  generalizability  of  findings  from  this  study  may  be 
determined  by  the  type  of  learning  hierarchies  used  (e.g., 
subject  area,  specific  content,  scope,  etc.),  the  position  of  the 
skipped  skill (s)   in  the  hierarchy,  target  population,  and 
subjects'   prior  knowledge  directly  and  indirectly  related  to  the 
hierarchy.     More  research,  therefore,  needs  to  be  done  witn 
different  learning  hierarchies  and  populations  before  any 
generalizations  can  be  made  with  confidence.     In  addition  to 
g-^neralizability,  other  issues  of  skipping  also  need  further 
exploration,  some  of  which  are  mentioned  here:     the  position  of 
skipped  skill(s),  the  type  of  skipping  'vertical  or  horizc. tal), 
and  more  specific  learner  attributes  of  those  who  can  skip  and 
who  cannot. 

This  study  provided  a  new  insight  to  Gagne's  learning 
hierarchies  theory.     Its  implications  may  impact  on  tne  practice 
of  classroom  teachers  and  Instructional  designers  regarding  the 
instructional  prescriptions  given  to  a  learner.     Although  not 
without  its  f  U  s,  this  study  will  serve  its  purpose  if  more 
research  along  "his  line  will  follow. 
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